-- Logs begin at Wed 2022-08-31 10:22:22 UTC, end at Wed 2022-08-31 11:24:07 UTC. -- Aug 31 10:56:33.142891 dv-cinder-855350-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 10:56:33.151929 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 10:56:33.153716 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 10:56:33 2022] *** Aug 31 10:56:33.153716 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 10:56:33.153716 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 10:56:33.153716 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: nodename: dv-cinder-855350-1-iscsi Aug 31 10:56:33.153716 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: machine: x86_64 Aug 31 10:56:33.153716 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: clock source: unix Aug 31 10:56:33.153716 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: pcre jit disabled Aug 31 10:56:33.153716 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: detected number of CPU cores: 4 Aug 31 10:56:33.153716 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: current working directory: / Aug 31 10:56:33.153716 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: detected binary path: /usr/bin/uwsgi-core Aug 31 10:56:33.154379 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: your processes number limit is 47680 Aug 31 10:56:33.154379 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: your memory page size is 4096 bytes Aug 31 10:56:33.154379 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: detected max file descriptor number: 2048 Aug 31 10:56:33.154379 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: lock engine: pthread robust mutexes Aug 31 10:56:33.154379 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: thunder lock: enabled Aug 31 10:56:33.154379 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 10:56:33.154379 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 10:56:33.193708 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: Python main interpreter initialized at 0x55a9e54d89c0 Aug 31 10:56:33.193708 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: python threads support enabled Aug 31 10:56:33.193708 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: your server socket listen backlog is limited to 100 connections Aug 31 10:56:33.193708 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: your mercy for graceful operations on workers is 90 seconds Aug 31 10:56:33.194101 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 10:56:33.194101 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: *** Operational MODE: preforking *** Aug 31 10:56:33.194375 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: *** uWSGI is running in multiple interpreter mode *** Aug 31 10:56:33.194375 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: spawned uWSGI master process (pid: 105664) Aug 31 10:56:33.194576 dv-cinder-855350-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 10:56:33.198326 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: spawned uWSGI worker 1 (pid: 105665, cores: 1) Aug 31 10:56:33.198326 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: spawned uWSGI worker 2 (pid: 105666, cores: 1) Aug 31 10:56:33.198326 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 10:56:33.855185 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 10:56:33.877754 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 10:56:34.958214 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:56:34.958214 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: from cryptography.utils import int_from_bytes Aug 31 10:56:34.958836 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:56:34.958836 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: from cryptography.utils import int_from_bytes Aug 31 10:56:34.986329 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:56:34.986329 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: from cryptography.utils import int_from_bytes Aug 31 10:56:34.986873 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:56:34.986873 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: from cryptography.utils import int_from_bytes Aug 31 10:56:37.475728 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:56:37.476541 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:56:37.476541 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:56:37.476926 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:56:37.477176 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:56:37.477557 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.477663 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:56:37.478023 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.478118 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:56:37.478202 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.478436 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:56:37.478529 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.478782 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.478868 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:56:37.479043 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:56:37.479129 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.479382 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.479486 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.479695 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.479790 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.480039 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.480129 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.480299 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.480394 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.480606 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.480691 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.480922 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855350-1-iscsi {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.481007 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.481238 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.481351 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.481539 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.481624 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.481840 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.481931 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.482139 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.482225 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.482435 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.482526 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.482750 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.482835 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855350-1-iscsi {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.483048 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.483192 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.483374 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.483566 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.483679 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.484064 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.484177 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.484355 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.484448 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.484597 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.484694 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.485005 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.485121 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.485376 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.485604 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.485760 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.485915 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.486084 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.486222 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.486389 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.486530 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.486709 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.486869 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.487015 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.487181 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.487414 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855350-1-iscsi {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.487511 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.487727 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.487821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.488052 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.488144 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.488365 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.488502 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.488724 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.488810 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.489062 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.489157 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855350-1-iscsi {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.489367 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.489453 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.489682 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.489783 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.490018 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.490102 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.490320 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.490446 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.490642 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.490740 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.490955 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.491091 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.491269 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.491361 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.491603 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.491691 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.491881 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.491973 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.492211 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.492308 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.492519 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.492608 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.492834 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.492929 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.493134 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.493261 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.493418 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.493557 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.493665 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.493776 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.493965 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.494088 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.494280 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.494408 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.494595 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.494716 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.494912 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.495016 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.495158 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.495250 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.495404 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.495550 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.495717 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.495872 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.496050 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.496224 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.496359 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.496548 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.496696 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.496792 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.496950 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.497043 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.497252 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.497346 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.497553 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.497639 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.497855 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.497940 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.498157 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.498250 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.498460 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.498582 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.498774 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.498863 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.499086 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.499194 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.499398 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.499495 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.499700 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.499821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.500022 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.500121 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.500344 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.501134 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.501232 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.501320 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.501527 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.501708 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.501814 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.501900 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.502228 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.502326 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.502459 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.502552 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.502775 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.502867 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.503081 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.503166 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.503380 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.503506 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.503682 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.503771 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.503983 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.504155 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.504322 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.504409 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.504653 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.504741 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.504954 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.505042 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.505199 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.505295 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.505494 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.505585 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.505792 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.505898 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.506107 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.506201 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.506407 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.506502 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.506697 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.506792 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.506995 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.507080 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.507289 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.507386 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.507588 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.507689 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.507887 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.507998 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.508230 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.508357 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.508498 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.508602 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.508797 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.508885 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.509095 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.509190 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.509396 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.509488 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.509693 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.509774 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.509994 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.510081 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.510296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.510382 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.510598 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.510686 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.510895 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.510971 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.511194 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.511277 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.511494 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.511588 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.511792 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.511891 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.512128 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.512218 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.512430 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.512528 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.512729 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.512814 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.513029 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.513134 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.513331 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.513424 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.513629 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.513760 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.513935 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.514026 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.514235 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.514381 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.514520 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.514649 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.514832 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.514970 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.515123 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.515222 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.515422 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.515508 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.515724 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.515809 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.516130 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.516728 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.516973 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.517099 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.517194 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.517284 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.517481 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.517570 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.517782 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.517882 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.518081 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.518167 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.518377 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.518463 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.518675 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.518773 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.518967 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.519056 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.519266 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.519358 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.519567 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.519731 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.519866 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.519951 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.520192 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.520322 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.520491 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.520577 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.520800 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.520893 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.521118 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.521203 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.521424 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.521514 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.521728 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.521813 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.522032 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.522124 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.522348 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:56:37.522434 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.522683 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.522778 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.522992 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.523078 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.523298 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.523386 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.523607 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.523735 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.523927 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.524056 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.524258 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.524358 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.524565 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.524649 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.524872 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.524968 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.525183 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.525268 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.525494 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.525590 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.525804 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.525896 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.526113 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.526198 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.526422 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.526519 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.526730 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.526828 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.527034 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.527131 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.527344 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.527430 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.527658 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.527750 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.527970 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.528087 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.528296 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.528383 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.528609 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.528702 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.528926 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.529012 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.529252 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.529337 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.529568 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.529654 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.529879 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.529973 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.530179 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.530264 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.530483 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.530571 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.530785 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.530874 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.531101 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.531192 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.531426 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.531514 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.531773 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.531865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.532123 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.532213 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.532434 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.532587 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.532748 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.532929 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.533055 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.533264 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.533359 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.533578 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.533664 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.533897 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.534019 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.534210 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.534303 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.534534 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.534621 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.534837 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.534930 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.535144 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.535229 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.535450 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.535542 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.535754 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.535840 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.536084 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.536182 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.536390 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.536471 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.536696 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.536790 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.537002 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.537090 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.537300 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.537376 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.537598 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.537680 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.537896 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.537978 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.538199 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.538282 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.538500 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.538593 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.538813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.538896 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.539117 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.539203 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.539418 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.539509 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.539720 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.539804 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.540048 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.540137 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.540357 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.540459 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.540661 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.540745 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.540966 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.541051 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.541278 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.541362 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.541584 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.541682 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.541904 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.541996 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.542215 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.542398 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.542523 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.542722 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.542835 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.543128 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.543222 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.543435 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.543638 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.543743 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.544069 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.544157 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.544397 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.544484 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.544705 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.544925 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.545017 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.545283 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.545370 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.545598 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.545799 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.545888 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.545963 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.546198 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.546285 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.546507 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.546592 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.546816 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.546901 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.547127 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.547214 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.547480 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.547590 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.547804 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.547992 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.548215 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.548333 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.548440 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.548640 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.548753 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.548965 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.549081 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.549289 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.549403 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.549604 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.549718 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.549913 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.550027 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.550219 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.550333 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.550523 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.550902 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.551006 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.551094 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.551174 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.551252 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.551398 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.551485 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.551697 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.551784 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.551995 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.552153 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.552318 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.552414 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.552619 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.552703 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.552915 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.553012 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.553216 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.553298 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.553519 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.553605 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.553816 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.553901 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.554115 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.554250 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.554413 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.554499 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.554713 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.554798 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.555013 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.555113 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.555354 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.555440 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.555658 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.555743 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.555981 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.556132 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.556321 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.556418 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.556627 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.556722 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.556938 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.557031 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.557242 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.557327 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.557548 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.557641 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.557853 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.557939 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.558156 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.558241 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.558467 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.558551 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.558769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.558854 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.559083 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.559168 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.559388 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.559488 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.559908 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.560045 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.560132 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.560212 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.560336 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.560435 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.560635 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.560774 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.560945 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.561033 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.561273 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.561365 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.561588 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.561674 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.561900 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.561985 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.562219 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.562314 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.562526 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.562618 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.562834 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.563454 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.563673 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.563776 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.563980 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.564135 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.564310 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.564399 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.564613 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.564699 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.564921 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.565006 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.565224 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.565315 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.565534 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.565611 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.565839 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.565913 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.566154 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.566229 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.566457 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.566543 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.566765 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.566839 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.567062 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.567138 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.567368 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.567452 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.567668 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.567753 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.567979 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.568118 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.568318 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.568411 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.568624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.568700 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.568940 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.569024 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.569245 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.569339 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.569548 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.569633 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.569857 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.569940 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.570157 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.570231 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.570457 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.570539 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.570758 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.570894 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.571060 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.571174 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.571362 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.571482 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.571666 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.571755 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.571963 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.572072 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.572294 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.572368 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.572595 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.572671 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.572894 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.572971 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.573193 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.573270 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.573493 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.573567 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.573793 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.573866 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.574097 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.574171 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.574450 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.574547 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.574719 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.574806 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.575013 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.575086 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.575311 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.575387 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.575626 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.575701 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.575926 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.576075 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.576247 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.576322 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.576548 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.576645 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.576847 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.576945 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.577145 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.577219 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.577446 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.577520 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.577758 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.577840 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.578329 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.578557 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.579187 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.579302 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.579499 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.579589 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.579900 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.579991 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.580237 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.580337 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.580551 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.580668 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.580854 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.580943 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.581164 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.581255 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.581471 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.581596 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.581777 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.581871 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.582084 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.582169 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.582395 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.582525 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.582698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.582842 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.583008 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.583167 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.583318 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.583472 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.583614 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.583743 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.583873 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.584210 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.584356 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.584517 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.584716 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.584853 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.584951 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.585057 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.585144 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.585354 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.585450 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.585684 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.585972 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.586068 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.586295 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.586382 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.586609 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.586699 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.586930 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.587017 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.587248 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.587343 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.587574 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.587667 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.587885 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.587980 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.588216 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.588320 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.588523 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.588609 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.588830 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.588962 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.589132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.589291 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.589441 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.589581 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.589745 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.589886 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.590030 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.590175 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.590344 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.590467 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.590582 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.590670 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.590880 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.590975 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.591180 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.591265 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.591478 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.591579 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.591778 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.591854 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.592105 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.592186 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.592406 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.592480 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.592713 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.592801 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.593013 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.593101 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.593324 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.593410 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.593625 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.593712 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.593925 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.594011 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.594326 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.594446 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.594571 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.594664 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.594875 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.595010 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.595181 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.595277 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.595524 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.595610 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.595830 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.595916 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.596191 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.596365 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.596491 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.596578 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.596793 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.596882 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.597114 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.597210 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.597413 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.597501 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.597710 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.597787 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.598013 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.598160 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.598314 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.598462 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.598596 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.598728 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.598901 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.598996 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.599205 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.599308 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.599509 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.599649 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.599818 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.599943 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.600346 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.600469 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.600553 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.600646 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.600727 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.600812 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.601011 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.601130 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.601319 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.601413 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.601622 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.601707 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.601920 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.602009 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.602217 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.602317 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.602514 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.602606 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.602814 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.602898 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.603113 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.603207 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.603415 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.603506 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.603713 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.603796 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.604031 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.604111 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.604338 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.604412 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.604637 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.604712 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.604936 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.605013 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.605237 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.605312 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.605536 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.605611 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.605833 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.605909 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.606141 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.606268 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.606440 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.606575 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.606737 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.606865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.607035 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.607175 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.607337 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.607498 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.607632 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.607773 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.607921 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.608099 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.608230 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.608433 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.608572 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.608706 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.608843 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.608973 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.609106 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.609254 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.609401 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.609500 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.609701 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.609810 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.610147 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.610243 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.610450 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.610587 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.610753 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.610898 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.611051 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.611203 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.611347 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.611508 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.611645 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.611811 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.611944 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.612137 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.612267 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.612441 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.612584 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.612743 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.612887 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.613050 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.613185 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.613368 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.613484 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.613674 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.613783 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.613978 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.614120 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.614281 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.614420 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.614584 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.614773 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.614926 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.615072 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.615231 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.615380 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.615587 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.615692 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.615890 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.615998 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.616231 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.616328 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.616549 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.616636 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.616857 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.616942 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.617165 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.617251 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.617475 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.617562 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.617776 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.617861 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.618073 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.618165 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.618370 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.618448 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.618683 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.618767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.618985 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.619079 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.619286 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.619379 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.619598 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.619683 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.619902 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.619994 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.620235 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.620323 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.620538 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.620623 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.620841 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.620944 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.621146 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.621232 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.621449 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.621540 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.621750 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.621844 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.622052 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.622138 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.622356 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.622445 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.622658 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.622745 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.622961 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.623048 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.623265 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.623360 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.623570 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.623658 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.623868 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.623953 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.624196 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.624284 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.624503 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.624592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.624802 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.624895 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.625107 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.625192 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.625980 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.626111 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.626327 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.626460 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.626633 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.626788 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.626935 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.627096 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.627241 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.627403 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.627540 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.627711 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.627974 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.628112 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.628305 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.628402 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.628612 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.628711 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.628914 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.629043 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.629219 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.629354 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.629526 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.629664 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.629843 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.629966 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.630153 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.630272 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.630451 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.630580 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.630861 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.630949 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.631168 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.631254 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.631474 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.631568 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.631778 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.631888 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.632098 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.632239 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.632399 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.632552 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.632703 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.632863 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.633021 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.633169 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.633319 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.633471 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.633617 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.633780 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.634010 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.634164 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.634249 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.634399 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.634543 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.634699 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.634830 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.635005 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.635212 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.635351 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.635513 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.635600 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.635811 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.635909 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.636250 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.636393 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.636574 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.636716 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.636841 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.636943 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.637157 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.637325 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.637471 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.637635 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.637787 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.637942 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.638085 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.638264 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.638392 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.638587 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.638714 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.638910 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.639010 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.639222 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.639318 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.639536 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.639622 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.639843 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.639941 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.640188 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.640277 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.640506 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.640593 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.640816 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.640914 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.641674 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.641776 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.641981 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.642067 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.642387 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.642480 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.642706 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.642798 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.643012 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.643098 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.643331 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.643469 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.643650 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.643784 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.643952 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.644145 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.644299 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.644389 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.644572 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.644660 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.644870 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.644984 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.645169 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.645289 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.645485 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.645593 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.645782 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.645900 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.646086 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.646204 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.646388 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.646506 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.646689 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.646828 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.646985 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.647136 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.647283 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.647441 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.647596 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.647748 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.647891 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.648079 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.648271 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.648438 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.648609 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.648753 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.648912 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.649017 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.649137 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.649270 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.649431 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.649596 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.649756 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.649906 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.650064 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.650229 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.650383 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.650552 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.650705 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.650848 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.650952 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.651159 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.651272 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.651466 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.651926 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.652118 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.652254 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.652392 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.652532 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.652713 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.652897 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.653041 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.653173 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.653307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.653442 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.653574 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.653683 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.653765 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.653832 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.653919 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.654006 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.654218 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.654310 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.654554 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.654697 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.654874 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.655006 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.655181 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.655303 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.655478 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.655594 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.655779 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.655924 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.656093 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.656243 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.656378 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.656505 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.656732 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.656832 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.657107 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.657202 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.657410 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.657518 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.657734 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.657879 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.658029 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.658158 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.658376 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.658518 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.658657 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.658754 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.658912 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.659030 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.659213 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.659364 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.659501 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.659629 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.659838 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.659930 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.660164 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.660270 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.660474 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.660615 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.660778 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.660905 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.661084 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.661222 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.661389 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.661652 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.661796 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.661936 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.662078 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.662228 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.662356 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.662487 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.662585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.662666 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.662876 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.662969 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.663188 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.663332 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.663468 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.663609 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.663783 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.663924 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.664120 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.664216 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.664432 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.664635 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.664767 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.664999 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.665145 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.665319 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.665408 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.665629 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.665722 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.665937 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.666083 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.666231 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.666495 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.666655 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.666825 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.666944 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.667133 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.667267 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.667440 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.667590 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.667729 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.667857 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.668061 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.668170 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.668376 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.668477 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.668694 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.668836 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.668984 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.669176 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.669325 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.669465 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.669589 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.669712 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.669917 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.670063 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.670230 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.670378 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.670542 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.670675 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.670870 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.670967 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.671188 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.671277 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.671496 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.671641 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.671880 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.672039 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.672168 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.672320 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.672526 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.672676 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.672842 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.672987 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.673185 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.673320 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.673449 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.673545 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.673747 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.673854 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.674059 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.674147 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.674374 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.674540 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.674676 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.674800 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.674978 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.675103 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.675286 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.675426 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.675597 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.675729 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.675904 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.676073 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.676239 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.676382 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.676544 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.676651 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.676867 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.677066 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.677227 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.677379 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.677508 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.677677 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.677818 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.678007 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.678137 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.678327 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.678488 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.678630 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.678888 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.679032 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.679262 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.679354 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.679523 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.679613 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.679848 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.680028 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.680180 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.680303 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.680465 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.680599 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.680767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.680923 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.681055 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.681186 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.681371 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.681511 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.681676 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.681809 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.681983 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.682154 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.682288 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.682407 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.682572 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.682687 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.682897 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.683099 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.683226 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.683437 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.683568 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.683746 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.683874 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.684096 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.684249 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.684419 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.684630 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.684769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.684979 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.685094 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.685296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.685411 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.685609 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.685750 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.685889 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.686010 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.686202 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.686341 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.686509 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.686646 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.686807 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.686942 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.687085 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.687222 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.687395 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.687522 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.687697 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.687791 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.688553 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.688710 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.688848 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.688986 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.689133 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.689255 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.689455 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.689588 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.689750 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.689836 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.690049 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.690136 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.690357 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.690564 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.690696 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.690831 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.690960 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.691086 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.691231 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.691333 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.691531 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.691619 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.691828 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.691916 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.692166 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.692324 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.692457 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.692588 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.692737 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.692861 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.693043 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.693239 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.693434 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.693575 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.693701 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.693821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.693974 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.694077 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.694212 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.694345 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.694516 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.694656 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.694825 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.694944 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.695127 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.695246 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.695437 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.695534 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.695739 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.695832 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.696084 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.696219 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.696395 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.696546 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.696682 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.696833 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.697011 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.697149 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.697319 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.697472 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.697642 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.697887 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.698028 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.698214 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.698355 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.698527 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.698622 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.698861 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.698950 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.699188 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.699430 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.699568 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.699765 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.699852 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.700084 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.700175 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.700409 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.700498 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.700715 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.700803 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.701019 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.701118 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.701323 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.701415 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.701625 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.701700 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.701927 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.702011 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.702230 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.702315 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.702530 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.702618 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.702833 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.703190 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.703398 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.703475 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.704295 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.704380 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.704604 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.704696 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.704908 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.705004 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.705211 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.705299 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.705515 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.705592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.705822 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.705903 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.706133 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.706209 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.706442 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.706525 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.706750 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.706835 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.707055 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.707136 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.707362 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.707438 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.707666 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.707743 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.707968 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.708065 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.708296 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.708397 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.708623 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.708728 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.708904 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.709068 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.709230 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.709394 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.709537 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.709612 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.709840 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.709941 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.710198 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.710284 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.710511 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.710606 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.710841 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.710936 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.711156 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.711251 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.711454 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.711547 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.711769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.711878 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.712111 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.712214 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.712419 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.712531 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.712736 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.712849 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.713043 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.713157 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.713365 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.713478 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.713702 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.713789 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.714025 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.714120 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.714345 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.714444 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.714645 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.714734 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.714944 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.715030 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.715242 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.715338 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.715546 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.715629 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.715856 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.715956 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.716186 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.716286 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.716486 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.716580 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.716784 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.716878 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.717088 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.717182 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.717385 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.717471 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.717684 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.717769 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.717984 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.718072 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.718282 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.718374 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.718584 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.718670 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.718880 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.718968 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.719212 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.719300 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.719513 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.719598 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.719836 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.719984 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.720170 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.720311 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.720473 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.720616 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.720778 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.720920 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.721083 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.721220 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.721382 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.721520 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.721684 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.721817 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.721986 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.722117 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.722292 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.722416 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.722596 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.722741 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.722899 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.723072 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.723199 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.723381 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.723500 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.723699 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.723914 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.724045 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.724142 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.724338 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.724463 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.724642 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.724770 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.724958 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.725085 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.725276 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.725395 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.725587 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.725716 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.725937 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.726044 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.726218 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.726313 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.726522 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.726635 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.726826 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.726948 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.727130 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.727256 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.727437 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.727586 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.727742 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.727894 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.728068 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.728226 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.728394 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.728536 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.728717 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.728851 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.729017 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.729160 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.729336 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.729469 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.729650 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.729795 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.729965 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.730120 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.730275 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.730426 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.730588 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.730750 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.730912 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.731066 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.731218 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.731384 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.731523 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.731696 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.731825 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.732018 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.732156 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.732355 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.732464 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.732666 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.732774 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.732976 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.733071 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.733284 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.733370 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.733593 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.733679 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.733902 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.733996 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.734216 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.734309 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.734524 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.734610 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.735414 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.735531 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.735671 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.735833 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.736066 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.736152 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.736325 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.736490 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.736652 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.736798 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.736964 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.737138 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.737289 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.737465 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.737616 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.737774 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.737961 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.738082 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.738272 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.738380 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.738614 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.738690 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:56:37.738942 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.739261 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.739571 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.739877 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:56:37.740143 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:56:37.893289 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO dbcounter [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Registered counter for database nova_api Aug 31 10:56:37.894874 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO dbcounter [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Registered counter for database nova_api Aug 31 10:56:37.915135 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_db.sqlalchemy.engines [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:56:37.916710 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG oslo_db.sqlalchemy.engines [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:56:37.921969 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writer thread running {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:56:37.924331 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG dbcounter [-] [105665] Writer thread running {{(pid=105665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:56:37.980242 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.context [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),113279e0-ed70-4e73-b063-0d2b7c31aff4(cell1) {{(pid=105666) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 10:56:37.981907 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.context [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),113279e0-ed70-4e73-b063-0d2b7c31aff4(cell1) {{(pid=105665) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 10:56:37.983984 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:37.984477 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:37.986321 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG oslo_concurrency.lockutils [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:37.986586 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:37.986800 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG oslo_concurrency.lockutils [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:37.987316 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:37.987752 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:37.988369 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG oslo_concurrency.lockutils [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:37.989103 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG oslo_concurrency.lockutils [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:37.989605 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG oslo_concurrency.lockutils [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:37.989728 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:37.991528 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG oslo_concurrency.lockutils [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:37.991702 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO dbcounter [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Registered counter for database nova_cell0 Aug 31 10:56:37.993581 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO dbcounter [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Registered counter for database nova_cell0 Aug 31 10:56:37.995829 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO dbcounter [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Registered counter for database nova_cell1 Aug 31 10:56:37.999341 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO dbcounter [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Registered counter for database nova_cell1 Aug 31 10:56:38.006744 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_db.sqlalchemy.engines [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:56:38.007669 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_db.sqlalchemy.engines [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:56:38.009402 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG oslo_db.sqlalchemy.engines [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:56:38.012340 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG oslo_db.sqlalchemy.engines [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:56:38.012924 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writer thread running {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:56:38.016688 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG dbcounter [-] [105665] Writer thread running {{(pid=105665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:56:38.156358 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG dbcounter [-] [105665] Writer thread running {{(pid=105665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:56:38.158308 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writer thread running {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:56:38.167234 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO dbcounter [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Registered counter for database nova_cell0 Aug 31 10:56:38.167414 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO dbcounter [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Registered counter for database nova_cell0 Aug 31 10:56:38.177145 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_db.sqlalchemy.engines [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:56:38.180988 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG oslo_db.sqlalchemy.engines [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:56:38.182505 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writer thread running {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:56:38.185149 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG dbcounter [-] [105665] Writer thread running {{(pid=105665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:56:38.529307 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: WARNING keystonemiddleware.auth_token [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 10:56:38.529905 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: WARNING keystonemiddleware.auth_token [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 10:56:38.537283 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: WARNING keystonemiddleware.auth_token [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 10:56:38.537977 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: WARNING keystonemiddleware.auth_token [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 10:56:38.881677 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: WARNING keystonemiddleware.auth_token [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 10:56:38.882437 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: WARNING keystonemiddleware.auth_token [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 10:56:38.887663 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: WARNING keystonemiddleware.auth_token [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 10:56:38.888424 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: WARNING keystonemiddleware.auth_token [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 10:56:38.893594 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a9e54d89c0 pid: 105665 (default app) Aug 31 10:56:38.894335 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a9e54d89c0 pid: 105666 (default app) Aug 31 10:56:38.895667 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:38.896896 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-3d58b37c-86e6-49ea-ab34-240b9ff9369e None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001770 Aug 31 10:56:38.897309 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Wed Aug 31 10:56:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:01.624303 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:01.625413 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002013 Aug 31 10:58:01.631584 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:01.646129 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG dbcounter [-] [105665] Writing DB stats nova_api:SELECT=3 {{(pid=105665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:01.650330 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG dbcounter [-] [105665] Writing DB stats nova_cell0:SELECT=3 {{(pid=105665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:01.653266 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG dbcounter [-] [105665] Writing DB stats nova_cell1:SELECT=3 {{(pid=105665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:01.655061 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG dbcounter [-] [105665] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:02.843802 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-c4e5c1c2-b781-4479-a5d2-27605cae215f admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:02.875809 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-c4e5c1c2-b781-4479-a5d2-27605cae215f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.242672 Aug 31 10:58:02.876625 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Aug 31 10:58:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:05.653289 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:05.655948 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-b298d247-3396-4d4e-a249-1b42a616584d None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002449 Aug 31 10:58:05.655948 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:06.326544 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-ac2d0dad-26f9-4b70-abfe-934cf547949a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:06.375748 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-ac2d0dad-26f9-4b70-abfe-934cf547949a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.712558 Aug 31 10:58:06.376358 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 10:58:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:58:06.394984 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writing DB stats nova_api:SELECT=3 {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:06.395894 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writing DB stats nova_cell0:SELECT=3 {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:06.398112 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writing DB stats nova_cell1:SELECT=3 {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:06.399501 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:06.629099 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-a89cd2e7-b298-4a4c-a687-4728f07c3c74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:06.702098 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-a89cd2e7-b298-4a4c-a687-4728f07c3c74 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.313542 Aug 31 10:58:06.702983 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 31 10:58:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:09.418168 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-ac2d0dad-26f9-4b70-abfe-934cf547949a admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:09.419915 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-ac2d0dad-26f9-4b70-abfe-934cf547949a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002677 Aug 31 10:58:09.420440 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:10.147407 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-420f6209-50dc-4773-b117-2ea52d51f5a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:10.192075 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-420f6209-50dc-4773-b117-2ea52d51f5a6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.764854 Aug 31 10:58:10.192825 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 10:58:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 10:58:10.205036 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-606ae9e1-80c0-483a-ba85-f6bad9c34544 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:10.243591 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-606ae9e1-80c0-483a-ba85-f6bad9c34544 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042281 Aug 31 10:58:10.244614 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 31 10:58:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:12.679951 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-420f6209-50dc-4773-b117-2ea52d51f5a6 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:12.681030 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-420f6209-50dc-4773-b117-2ea52d51f5a6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 31 10:58:12.681436 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:13.108156 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6f3c72e1-6799-41f4-80de-a9ea1788fb39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "name": "ds1G"}} {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:13.133344 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6f3c72e1-6799-41f4-80de-a9ea1788fb39 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444311 Aug 31 10:58:13.133921 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 10:58:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:58:13.146288 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-1e5d430b-345e-4630-bc7d-210b9fbacbc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:13.174126 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-1e5d430b-345e-4630-bc7d-210b9fbacbc1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031591 Aug 31 10:58:13.175154 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 31 10:58:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:15.839130 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6f3c72e1-6799-41f4-80de-a9ea1788fb39 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:15.840302 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6f3c72e1-6799-41f4-80de-a9ea1788fb39 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Aug 31 10:58:15.840724 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:16.357889 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-a104d3d3-546f-41ba-93d1-a280f854e7a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "vcpus": 2, "name": "ds2G"}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:16.383089 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-a104d3d3-546f-41ba-93d1-a280f854e7a1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.535400 Aug 31 10:58:16.383845 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 10:58:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:58:16.398174 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-425d171f-6ecd-4514-9711-c868d0737650 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:16.425138 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-425d171f-6ecd-4514-9711-c868d0737650 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031422 Aug 31 10:58:16.425929 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 31 10:58:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:18.884388 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-a104d3d3-546f-41ba-93d1-a280f854e7a1 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:18.885570 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-a104d3d3-546f-41ba-93d1-a280f854e7a1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 31 10:58:18.886206 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:19.319111 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6b2fe737-e7e7-49b0-af49-5cb824686bc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4, "ram": 4096}} {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:19.343228 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6b2fe737-e7e7-49b0-af49-5cb824686bc5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450686 Aug 31 10:58:19.344104 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 10:58:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:58:19.359165 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-ed9743ad-4688-45fa-8a76-5fc270254969 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:19.391182 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-ed9743ad-4688-45fa-8a76-5fc270254969 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036179 Aug 31 10:58:19.392333 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 31 10:58:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:22.280982 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6b2fe737-e7e7-49b0-af49-5cb824686bc5 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:22.282201 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6b2fe737-e7e7-49b0-af49-5cb824686bc5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001709 Aug 31 10:58:22.282633 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:22.736256 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-38f9fc11-969e-4c3a-b8cd-6a307c84a896 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:22.761953 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-38f9fc11-969e-4c3a-b8cd-6a307c84a896 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.472976 Aug 31 10:58:22.762514 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Aug 31 10:58:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:25.246391 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6b2fe737-e7e7-49b0-af49-5cb824686bc5 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:25.247525 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6b2fe737-e7e7-49b0-af49-5cb824686bc5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 31 10:58:25.247930 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:25.752088 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-3f10b447-9f99-4362-a560-1b7c041288d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "1", "name": "m1.tiny"}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:25.772815 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-3f10b447-9f99-4362-a560-1b7c041288d3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.518043 Aug 31 10:58:25.773670 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 10:58:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:58:25.795557 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-0847906d-cc12-4775-a62e-3a91f323e674 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:25.831044 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-0847906d-cc12-4775-a62e-3a91f323e674 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042498 Aug 31 10:58:25.831805 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 31 10:58:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:28.277212 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-3f10b447-9f99-4362-a560-1b7c041288d3 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:28.278230 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-3f10b447-9f99-4362-a560-1b7c041288d3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 31 10:58:28.278643 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:58:28.685726 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-99967592-2141-42a0-a907-1965fabe44f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:28.717249 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-99967592-2141-42a0-a907-1965fabe44f4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.432373 Aug 31 10:58:28.717975 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 10:58:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:58:28.730697 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-e561a631-2742-453c-b4e2-32f29de90282 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:28.753870 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-e561a631-2742-453c-b4e2-32f29de90282 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027171 Aug 31 10:58:28.754456 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 31 10:58:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:31.241392 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-99967592-2141-42a0-a907-1965fabe44f4 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:31.242411 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-99967592-2141-42a0-a907-1965fabe44f4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 31 10:58:31.243079 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:31.709534 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-76aefeea-2382-4288-834a-a36119626b1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "id": "3", "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:31.735308 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-76aefeea-2382-4288-834a-a36119626b1f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.485544 Aug 31 10:58:31.735963 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 10:58:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 10:58:31.748680 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-23e5ad14-9f02-46a3-88b2-cc13ecdac138 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:31.753824 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG dbcounter [-] [105665] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:31.789724 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-23e5ad14-9f02-46a3-88b2-cc13ecdac138 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044740 Aug 31 10:58:31.790337 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 31 10:58:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:34.219663 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-76aefeea-2382-4288-834a-a36119626b1f admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:34.220830 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-76aefeea-2382-4288-834a-a36119626b1f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 31 10:58:34.221489 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:34.679769 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-360d9626-f746-4c5e-a66f-7994b6a9b892 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "id": "4", "vcpus": 4}} {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:34.705942 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-360d9626-f746-4c5e-a66f-7994b6a9b892 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478273 Aug 31 10:58:34.706804 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 10:58:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:58:34.720831 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-ec456823-1a64-48e0-9a57-534d2e6831fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:34.745993 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-ec456823-1a64-48e0-9a57-534d2e6831fc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029767 Aug 31 10:58:34.746681 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 31 10:58:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:37.281001 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-360d9626-f746-4c5e-a66f-7994b6a9b892 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:37.282012 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-360d9626-f746-4c5e-a66f-7994b6a9b892 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 31 10:58:37.282411 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:37.721185 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-f6a0a9f5-4367-496a-a7a4-50041669413c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "ram": 16384, "swap": 0, "vcpus": 8, "disk": 160}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:37.742657 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-f6a0a9f5-4367-496a-a7a4-50041669413c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.453670 Aug 31 10:58:37.744074 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 10:58:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 10:58:37.755920 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-b4b6fef8-e636-428f-ab35-85d9b9717e47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:37.783513 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-b4b6fef8-e636-428f-ab35-85d9b9717e47 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031172 Aug 31 10:58:37.784271 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 31 10:58:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:56.439220 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-f6a0a9f5-4367-496a-a7a4-50041669413c admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:56.440257 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-f6a0a9f5-4367-496a-a7a4-50041669413c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 31 10:58:56.440661 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 10:58:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:56.452288 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG dbcounter [-] [105665] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:56.861183 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-99ff07c0-d54a-4b3a-8145-963804a18c3f admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:56.880842 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-99ff07c0-d54a-4b3a-8145-963804a18c3f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.433002 Aug 31 10:58:56.881399 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Aug 31 10:58:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:58.060689 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-f6a0a9f5-4367-496a-a7a4-50041669413c admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:58.062064 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-f6a0a9f5-4367-496a-a7a4-50041669413c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Aug 31 10:58:58.062587 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 10:58:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:58:58.707094 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-d37747ea-6a97-47b3-a2cb-920c90cc4813 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:58.713885 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.wsgi [None req-d37747ea-6a97-47b3-a2cb-920c90cc4813 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-d37747ea-6a97-47b3-a2cb-920c90cc4813 admin admin] Request method failure captured: Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Accept: application/json Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Accept-Encoding: gzip, deflate Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Connection: keep-alive Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Content-Length: 0 Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Host: 10.222.0.20 Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Openstack-Api-Version: compute 2.90 Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Openstack-System-Scope: None Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: User-Agent: python-novaclient Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Auth-Token: gAAAAABjDz7xwnUvz1sP52qc1nx0wx7k9qwm1kukh3ZUoo1dNqmrlkzSROAjAQ_qLuVJzedC9muODPhUj1C9HJ0OYR-dxD1JvGoXkHcPR00IehcoIhaqz3_6TP-hrzTR3jpBeWA-u12kEDM3rQ8GlrrNyfoCnqgy212SDn_fwwIta2Kf841Abj0 Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Domain-Id: None Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Domain-Name: None Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Identity-Status: Confirmed Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Is-Admin-Project: True Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Project-Domain-Id: default Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Project-Domain-Name: Default Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Project-Id: 34b2b6cdb81943ad9b9237874eeca93b Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Project-Name: admin Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Role: reader,member,admin Aug 31 10:58:58.717290 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Roles: reader,member,admin Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b2b6cdb81943ad9b9237874eeca93b"}]}] Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Tenant: admin Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Tenant-Id: 34b2b6cdb81943ad9b9237874eeca93b Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Tenant-Name: admin Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User: admin Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User-Domain-Id: default Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User-Domain-Name: Default Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User-Id: a29c05a14dda47f2a0f073398ac0dadb Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User-Name: admin Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: method: > Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: exception: Flavor 42 could not be found. Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: action_args: {'id': '42'} Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:58:58.720307 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:58:58.722217 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:58:58.724782 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-d37747ea-6a97-47b3-a2cb-920c90cc4813 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:58:58.727670 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-d37747ea-6a97-47b3-a2cb-920c90cc4813 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.511791 Aug 31 10:58:58.727670 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 31 10:58:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 513 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 10:58:58.730789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-f9c945ad-5a8f-48cd-be9a-505fb503a116 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:58.735148 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:58.757565 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-f9c945ad-5a8f-48cd-be9a-505fb503a116 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031090 Aug 31 10:58:58.758799 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 31 10:58:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:58.769133 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-8e955f9b-b838-4318-8b30-9a5128aacf22 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:58.794358 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-8e955f9b-b838-4318-8b30-9a5128aacf22 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028822 Aug 31 10:58:58.794936 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 31 10:58:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:58.805155 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-a60a8584-194d-4ba2-a2d7-fc3e9bd05c6e admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:58.812470 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.wsgi [None req-a60a8584-194d-4ba2-a2d7-fc3e9bd05c6e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-a60a8584-194d-4ba2-a2d7-fc3e9bd05c6e admin admin] Request method failure captured: Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Accept: application/json Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Accept-Encoding: gzip, deflate Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Connection: keep-alive Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Content-Length: 0 Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Host: 10.222.0.20 Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Openstack-Api-Version: compute 2.90 Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Openstack-System-Scope: None Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: User-Agent: python-novaclient Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Auth-Token: gAAAAABjDz7xwnUvz1sP52qc1nx0wx7k9qwm1kukh3ZUoo1dNqmrlkzSROAjAQ_qLuVJzedC9muODPhUj1C9HJ0OYR-dxD1JvGoXkHcPR00IehcoIhaqz3_6TP-hrzTR3jpBeWA-u12kEDM3rQ8GlrrNyfoCnqgy212SDn_fwwIta2Kf841Abj0 Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Domain-Id: None Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Domain-Name: None Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Identity-Status: Confirmed Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Is-Admin-Project: True Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Project-Domain-Id: default Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Project-Domain-Name: Default Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Project-Id: 34b2b6cdb81943ad9b9237874eeca93b Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Project-Name: admin Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Role: reader,member,admin Aug 31 10:58:58.815964 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Roles: reader,member,admin Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b2b6cdb81943ad9b9237874eeca93b"}]}] Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Tenant: admin Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Tenant-Id: 34b2b6cdb81943ad9b9237874eeca93b Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Tenant-Name: admin Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User: admin Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User-Domain-Id: default Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User-Domain-Name: Default Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User-Id: a29c05a14dda47f2a0f073398ac0dadb Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User-Name: admin Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: method: > Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: exception: Flavor 42 could not be found. Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: action_args: {'id': '42'} Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:58:58.817767 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:58:58.818835 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:58:58.821585 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-a60a8584-194d-4ba2-a2d7-fc3e9bd05c6e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:58:58.823584 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-a60a8584-194d-4ba2-a2d7-fc3e9bd05c6e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016492 Aug 31 10:58:58.823584 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 31 10:58:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 10:58:59.857318 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-8e955f9b-b838-4318-8b30-9a5128aacf22 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:59.858396 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-8e955f9b-b838-4318-8b30-9a5128aacf22 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 31 10:58:59.858809 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 10:58:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:59:00.466383 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-28e468cf-1414-4436-af3b-676ddf8a5c68 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:00.475357 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.wsgi [None req-28e468cf-1414-4436-af3b-676ddf8a5c68 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-28e468cf-1414-4436-af3b-676ddf8a5c68 admin admin] Request method failure captured: Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Accept: application/json Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Accept-Encoding: gzip, deflate Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Connection: keep-alive Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Content-Length: 0 Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Host: 10.222.0.20 Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Openstack-Api-Version: compute 2.90 Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Openstack-System-Scope: None Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: User-Agent: python-novaclient Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Auth-Token: gAAAAABjDz7zzjWxL0mcfBvqvhUEUoYPUDxlmbMtHKI0dU_dheyvAc1rZVgBvI7OyWlYsTzADGsZ4NxQRgG3epJqNOhFK0YA9Js9vjglee92D3iF0z4sRzV1OPH-w8rDJZBp9qWsx2h7ZIhiH2rGmRtdNxU9hrDVD88ssM8D636XatnEoJUwq3E Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Domain-Id: None Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Domain-Name: None Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Identity-Status: Confirmed Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Is-Admin-Project: True Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Project-Domain-Id: default Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Project-Domain-Name: Default Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Project-Id: 34b2b6cdb81943ad9b9237874eeca93b Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Project-Name: admin Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Role: reader,member,admin Aug 31 10:59:00.478177 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Roles: reader,member,admin Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b2b6cdb81943ad9b9237874eeca93b"}]}] Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Tenant: admin Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Tenant-Id: 34b2b6cdb81943ad9b9237874eeca93b Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Tenant-Name: admin Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User: admin Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User-Domain-Id: default Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User-Domain-Name: Default Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User-Id: a29c05a14dda47f2a0f073398ac0dadb Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User-Name: admin Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: method: > Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: exception: Flavor 84 could not be found. Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: action_args: {'id': '84'} Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:59:00.479769 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:00.480698 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:59:00.481789 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-28e468cf-1414-4436-af3b-676ddf8a5c68 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:59:00.483287 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-28e468cf-1414-4436-af3b-676ddf8a5c68 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.468489 Aug 31 10:59:00.483287 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 31 10:59:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:00.490864 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-3925b164-b47d-4513-9360-93688d06d1ca admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:00.506800 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-3925b164-b47d-4513-9360-93688d06d1ca admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019470 Aug 31 10:59:00.507380 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 31 10:59:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:59:00.518525 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-f98c7e52-ee60-40a6-bcf3-417d9c8edc77 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:00.538452 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-f98c7e52-ee60-40a6-bcf3-417d9c8edc77 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023780 Aug 31 10:59:00.539048 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 31 10:59:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:00.548859 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-8bf63191-815b-400c-a2f9-770fd96c78ed admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:00.554595 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.wsgi [None req-8bf63191-815b-400c-a2f9-770fd96c78ed admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-8bf63191-815b-400c-a2f9-770fd96c78ed admin admin] Request method failure captured: Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Accept: application/json Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Accept-Encoding: gzip, deflate Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Connection: keep-alive Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Content-Length: 0 Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Host: 10.222.0.20 Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Openstack-Api-Version: compute 2.90 Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Openstack-System-Scope: None Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: User-Agent: python-novaclient Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Auth-Token: gAAAAABjDz7zzjWxL0mcfBvqvhUEUoYPUDxlmbMtHKI0dU_dheyvAc1rZVgBvI7OyWlYsTzADGsZ4NxQRgG3epJqNOhFK0YA9Js9vjglee92D3iF0z4sRzV1OPH-w8rDJZBp9qWsx2h7ZIhiH2rGmRtdNxU9hrDVD88ssM8D636XatnEoJUwq3E Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Domain-Id: None Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Domain-Name: None Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Identity-Status: Confirmed Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Is-Admin-Project: True Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Project-Domain-Id: default Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Project-Domain-Name: Default Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Project-Id: 34b2b6cdb81943ad9b9237874eeca93b Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Project-Name: admin Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Role: reader,member,admin Aug 31 10:59:00.556813 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Roles: reader,member,admin Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b2b6cdb81943ad9b9237874eeca93b"}]}] Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Tenant: admin Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Tenant-Id: 34b2b6cdb81943ad9b9237874eeca93b Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Tenant-Name: admin Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User: admin Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User-Domain-Id: default Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User-Domain-Name: Default Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User-Id: a29c05a14dda47f2a0f073398ac0dadb Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User-Name: admin Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: method: > Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: exception: Flavor 84 could not be found. Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: action_args: {'id': '84'} Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:59:00.558821 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:00.559806 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:59:00.561592 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-8bf63191-815b-400c-a2f9-770fd96c78ed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:59:00.562816 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-8bf63191-815b-400c-a2f9-770fd96c78ed admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013420 Aug 31 10:59:00.562816 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 31 10:59:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:01.665888 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-f98c7e52-ee60-40a6-bcf3-417d9c8edc77 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:01.667724 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-f98c7e52-ee60-40a6-bcf3-417d9c8edc77 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003849 Aug 31 10:59:01.668313 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 10:59:01 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:59:02.317399 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6a452d21-bae9-4e5c-be73-530108b88c4c admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:02.324501 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.wsgi [None req-6a452d21-bae9-4e5c-be73-530108b88c4c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6a452d21-bae9-4e5c-be73-530108b88c4c admin admin] Request method failure captured: Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Accept: application/json Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Accept-Encoding: gzip, deflate Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Connection: keep-alive Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Content-Length: 0 Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Host: 10.222.0.20 Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Openstack-Api-Version: compute 2.90 Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Openstack-System-Scope: None Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: User-Agent: python-novaclient Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Auth-Token: gAAAAABjDz71F0oz5Z5dsS5Dp8ASTH03xSnK2-9_jONiOsM4Cllf07eoxa_r5E1U8f9q44eyubht8epEvJJv_aF9G6doP0Ez-MT63j_6wOrd1ksCGMusEFyIc-lR7A7cbFWPRxpf8k-MrXPVSd5hgPTbsfnfgqPcS7BK8Uz79prOTqaHIEcuzjc Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Domain-Id: None Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Domain-Name: None Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Identity-Status: Confirmed Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Is-Admin-Project: True Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Project-Domain-Id: default Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Project-Domain-Name: Default Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Project-Id: 34b2b6cdb81943ad9b9237874eeca93b Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Project-Name: admin Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Role: reader,member,admin Aug 31 10:59:02.326073 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Roles: reader,member,admin Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b2b6cdb81943ad9b9237874eeca93b"}]}] Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Tenant: admin Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Tenant-Id: 34b2b6cdb81943ad9b9237874eeca93b Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-Tenant-Name: admin Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User: admin Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User-Domain-Id: default Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User-Domain-Name: Default Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User-Id: a29c05a14dda47f2a0f073398ac0dadb Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: X-User-Name: admin Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: method: > Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: exception: Flavor 451 could not be found. Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: action_args: {'id': '451'} Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:59:02.328296 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:02.329865 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: ERROR nova.api.openstack.wsgi Aug 31 10:59:02.331876 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6a452d21-bae9-4e5c-be73-530108b88c4c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:59:02.334509 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6a452d21-bae9-4e5c-be73-530108b88c4c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.513414 Aug 31 10:59:02.334509 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 31 10:59:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 515 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:02.340484 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-e552e0b9-754c-4ec3-979c-c7862fd154e0 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:02.357046 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-e552e0b9-754c-4ec3-979c-c7862fd154e0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020140 Aug 31 10:59:02.357624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 31 10:59:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:59:02.369066 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:02.385871 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021343 Aug 31 10:59:02.386450 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 31 10:59:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:59:02.403897 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-c723e5e1-3966-46ef-87ab-3d55bf5f3bc8 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:02.413635 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.wsgi [None req-c723e5e1-3966-46ef-87ab-3d55bf5f3bc8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-c723e5e1-3966-46ef-87ab-3d55bf5f3bc8 admin admin] Request method failure captured: Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Accept: application/json Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Accept-Encoding: gzip, deflate Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Connection: keep-alive Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Content-Length: 0 Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Host: 10.222.0.20 Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Openstack-Api-Version: compute 2.90 Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Openstack-System-Scope: None Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: User-Agent: python-novaclient Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Auth-Token: gAAAAABjDz71F0oz5Z5dsS5Dp8ASTH03xSnK2-9_jONiOsM4Cllf07eoxa_r5E1U8f9q44eyubht8epEvJJv_aF9G6doP0Ez-MT63j_6wOrd1ksCGMusEFyIc-lR7A7cbFWPRxpf8k-MrXPVSd5hgPTbsfnfgqPcS7BK8Uz79prOTqaHIEcuzjc Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Domain-Id: None Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Domain-Name: None Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Identity-Status: Confirmed Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Is-Admin-Project: True Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Project-Domain-Id: default Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Project-Domain-Name: Default Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Project-Id: 34b2b6cdb81943ad9b9237874eeca93b Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Project-Name: admin Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Role: reader,member,admin Aug 31 10:59:02.417132 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Roles: reader,member,admin Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b2b6cdb81943ad9b9237874eeca93b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b2b6cdb81943ad9b9237874eeca93b"}]}] Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Tenant: admin Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Tenant-Id: 34b2b6cdb81943ad9b9237874eeca93b Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-Tenant-Name: admin Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User: admin Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User-Domain-Id: default Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User-Domain-Name: Default Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User-Id: a29c05a14dda47f2a0f073398ac0dadb Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: X-User-Name: admin Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: method: > Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: exception: Flavor 451 could not be found. Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: action_args: {'id': '451'} Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:59:02.419453 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:02.420369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: ERROR nova.api.openstack.wsgi Aug 31 10:59:02.421624 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-c723e5e1-3966-46ef-87ab-3d55bf5f3bc8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:59:02.422627 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-c723e5e1-3966-46ef-87ab-3d55bf5f3bc8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.022990 Aug 31 10:59:02.422627 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 31 10:59:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:03.541136 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:03.542236 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 Aug 31 10:59:03.542723 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 10:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:04.110349 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-c76b5646-4463-40a6-bbd0-8424337bf019 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:04.131075 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-c76b5646-4463-40a6-bbd0-8424337bf019 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.447418 Aug 31 10:59:04.131738 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 31 10:59:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 10:59:05.175620 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:05.176840 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001823 Aug 31 10:59:05.177313 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 10:59:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:05.754131 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-5b054927-91c9-45e1-b66a-d044226428c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:05.775589 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-5b054927-91c9-45e1-b66a-d044226428c1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.458358 Aug 31 10:59:05.776220 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 31 10:59:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:59:06.794470 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:06.795480 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 31 10:59:06.795879 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 10:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:07.403221 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-bae085b0-328d-4b15-bd7f-5e67694b156b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:07.427616 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-bae085b0-328d-4b15-bd7f-5e67694b156b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.487417 Aug 31 10:59:07.428486 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 31 10:59:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:59:08.499059 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:08.500207 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Aug 31 10:59:08.500698 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 10:59:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:09.103257 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-42d8167b-8575-46fe-aad1-45c43699b90c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:09.129813 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-42d8167b-8575-46fe-aad1-45c43699b90c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.478967 Aug 31 10:59:09.130805 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 31 10:59:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:59:10.206347 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:10.207411 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 31 10:59:10.207873 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 10:59:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:10.817140 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-b5660085-cb1d-498d-9eba-2939e5715c2d admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:10.840205 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-b5660085-cb1d-498d-9eba-2939e5715c2d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.492197 Aug 31 10:59:10.840791 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Wed Aug 31 10:59:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:00:09.337731 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:09.338798 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-6a376a51-e5f7-4152-8ce0-8da6511f9dc2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 31 11:00:09.339245 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 11:00:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:09.351028 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:09.787683 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-197d12f0-bb14-4f5b-a757-a5fd78985367 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:09.809694 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-197d12f0-bb14-4f5b-a757-a5fd78985367 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.463640 Aug 31 11:00:09.810284 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Aug 31 11:00:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:09.832535 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG dbcounter [-] [105665] Writing DB stats nova_api:SELECT=14 {{(pid=105665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:09.836524 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-a4097209-c659-4e11-a4cf-18697e1a249e admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:09.844904 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-a4097209-c659-4e11-a4cf-18697e1a249e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013812 Aug 31 11:00:09.845463 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1283 bytes} [Wed Aug 31 11:00:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:09.857854 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-d9768eac-94e5-48b8-8b62-b121b491d679 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:09.866581 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-d9768eac-94e5-48b8-8b62-b121b491d679 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012216 Aug 31 11:00:09.867071 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1286 bytes} [Wed Aug 31 11:00:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:00:09.880121 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-fab4343a-871b-4a7f-bb3e-659b0d23331d admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:09.888096 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-fab4343a-871b-4a7f-bb3e-659b0d23331d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012323 Aug 31 11:00:09.888665 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1286 bytes} [Wed Aug 31 11:00:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:09.901495 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-f74a8e57-3cd9-4375-b421-6695a25d907d admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:09.909474 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-f74a8e57-3cd9-4375-b421-6695a25d907d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011548 Aug 31 11:00:09.910186 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1283 bytes} [Wed Aug 31 11:00:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:12.421426 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-fab4343a-871b-4a7f-bb3e-659b0d23331d admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:12.422527 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-fab4343a-871b-4a7f-bb3e-659b0d23331d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 31 11:03:12.422963 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 11:03:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:03:12.578978 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writing DB stats nova_api:SELECT=6 {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:12.765555 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-b9626c4a-ef37-45e6-a732-50fd8f5c55c5 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:12.769295 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-b9626c4a-ef37-45e6-a732-50fd8f5c55c5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:12.769772 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-b9626c4a-ef37-45e6-a732-50fd8f5c55c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:12.770200 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-b9626c4a-ef37-45e6-a732-50fd8f5c55c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:12.770912 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-b9626c4a-ef37-45e6-a732-50fd8f5c55c5 admin admin] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:12.771354 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-b9626c4a-ef37-45e6-a732-50fd8f5c55c5 admin admin] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:12.771776 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-b9626c4a-ef37-45e6-a732-50fd8f5c55c5 admin admin] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:12.807891 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-b9626c4a-ef37-45e6-a732-50fd8f5c55c5 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.234529 Aug 31 11:03:12.808781 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 31 11:03:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 11:03:13.679351 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-fab4343a-871b-4a7f-bb3e-659b0d23331d admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:13.680945 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-fab4343a-871b-4a7f-bb3e-659b0d23331d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 31 11:03:13.681361 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 11:03:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:03:13.886310 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-c415c594-09f7-420b-9357-ff929d3ddc91 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:13.889862 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-c415c594-09f7-420b-9357-ff929d3ddc91 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:13.890336 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-c415c594-09f7-420b-9357-ff929d3ddc91 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:13.890811 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-c415c594-09f7-420b-9357-ff929d3ddc91 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:13.891467 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-c415c594-09f7-420b-9357-ff929d3ddc91 admin admin] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:13.891905 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-c415c594-09f7-420b-9357-ff929d3ddc91 admin admin] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:13.892346 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-c415c594-09f7-420b-9357-ff929d3ddc91 admin admin] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:13.912808 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-c415c594-09f7-420b-9357-ff929d3ddc91 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.087962 Aug 31 11:03:13.913398 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 31 11:03:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:03:25.164628 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-fab4343a-871b-4a7f-bb3e-659b0d23331d admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:25.165720 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-fab4343a-871b-4a7f-bb3e-659b0d23331d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001733 Aug 31 11:03:25.166256 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 11:03:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:03:25.310481 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writing DB stats nova_cell0:SELECT=4 {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:25.311203 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writing DB stats nova_cell1:SELECT=4 {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:25.311792 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG dbcounter [-] [105666] Writing DB stats nova_api:SELECT=8 {{(pid=105666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:25.366369 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-cf4a482a-4f05-4321-a8a0-8d5bf0431fc3 admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:25.370923 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-cf4a482a-4f05-4321-a8a0-8d5bf0431fc3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:25.371512 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-cf4a482a-4f05-4321-a8a0-8d5bf0431fc3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:25.372130 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-cf4a482a-4f05-4321-a8a0-8d5bf0431fc3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:25.373104 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-cf4a482a-4f05-4321-a8a0-8d5bf0431fc3 admin admin] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:25.373513 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-cf4a482a-4f05-4321-a8a0-8d5bf0431fc3 admin admin] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:25.374107 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-cf4a482a-4f05-4321-a8a0-8d5bf0431fc3 admin admin] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:25.401932 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-cf4a482a-4f05-4321-a8a0-8d5bf0431fc3 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.096205 Aug 31 11:03:25.402525 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 37/74] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 31 11:03:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:03:26.238148 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: DEBUG nova.api.openstack.wsgi [None req-fab4343a-871b-4a7f-bb3e-659b0d23331d admin admin] Calling method '>' {{(pid=105665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:26.239244 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: INFO nova.api.openstack.requestlog [None req-fab4343a-871b-4a7f-bb3e-659b0d23331d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 31 11:03:26.239726 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: [pid: 105665|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 11:03:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:03:26.448237 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG nova.api.openstack.wsgi [None req-f7d232e2-7a47-43be-9931-e39e887b1f3b admin admin] Calling method '>' {{(pid=105666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:26.451662 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-f7d232e2-7a47-43be-9931-e39e887b1f3b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:26.452166 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-f7d232e2-7a47-43be-9931-e39e887b1f3b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:26.452600 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-f7d232e2-7a47-43be-9931-e39e887b1f3b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:26.453307 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-f7d232e2-7a47-43be-9931-e39e887b1f3b admin admin] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:26.453747 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-f7d232e2-7a47-43be-9931-e39e887b1f3b admin admin] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:26.454167 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: DEBUG oslo_concurrency.lockutils [None req-f7d232e2-7a47-43be-9931-e39e887b1f3b admin admin] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:26.477618 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: INFO nova.api.openstack.requestlog [None req-f7d232e2-7a47-43be-9931-e39e887b1f3b admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086616 Aug 31 11:03:26.478192 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: [pid: 105666|app: 0|req: 38/76] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 31 11:03:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:04:25.009076 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: Wed Aug 31 11:04:25 2022 - graceful shutdown triggered... Aug 31 11:04:25.009195 dv-cinder-855350-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 11:04:25.010198 dv-cinder-855350-1-iscsi devstack@n-api.service[105665]: Gracefully killing worker 1 (pid: 105665)... Aug 31 11:04:25.010640 dv-cinder-855350-1-iscsi devstack@n-api.service[105666]: Gracefully killing worker 2 (pid: 105666)... Aug 31 11:04:26.011307 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: worker 1 buried after 1 seconds Aug 31 11:04:26.011876 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: worker 2 buried after 1 seconds Aug 31 11:04:26.011876 dv-cinder-855350-1-iscsi devstack@n-api.service[105664]: goodbye to uWSGI. Aug 31 11:04:26.013019 dv-cinder-855350-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 11:04:26.013633 dv-cinder-855350-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 11:04:26.016679 dv-cinder-855350-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 11:04:26.030896 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 11:04:26.033150 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 11:04:26 2022] *** Aug 31 11:04:26.033150 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 11:04:26.033150 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 11:04:26.033150 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: nodename: dv-cinder-855350-1-iscsi Aug 31 11:04:26.033150 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: machine: x86_64 Aug 31 11:04:26.033150 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: clock source: unix Aug 31 11:04:26.033150 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: pcre jit disabled Aug 31 11:04:26.033150 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: detected number of CPU cores: 4 Aug 31 11:04:26.033150 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: current working directory: / Aug 31 11:04:26.033150 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: detected binary path: /usr/bin/uwsgi-core Aug 31 11:04:26.033150 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: your processes number limit is 47680 Aug 31 11:04:26.033150 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: your memory page size is 4096 bytes Aug 31 11:04:26.034090 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: detected max file descriptor number: 2048 Aug 31 11:04:26.034090 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: lock engine: pthread robust mutexes Aug 31 11:04:26.034090 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: thunder lock: enabled Aug 31 11:04:26.034090 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 11:04:26.034090 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 11:04:26.077063 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: Python main interpreter initialized at 0x56164aa7d9c0 Aug 31 11:04:26.077063 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: python threads support enabled Aug 31 11:04:26.077063 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: your server socket listen backlog is limited to 100 connections Aug 31 11:04:26.077063 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: your mercy for graceful operations on workers is 90 seconds Aug 31 11:04:26.077425 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 11:04:26.077425 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: *** Operational MODE: preforking *** Aug 31 11:04:26.077705 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: *** uWSGI is running in multiple interpreter mode *** Aug 31 11:04:26.077705 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: spawned uWSGI master process (pid: 120635) Aug 31 11:04:26.077913 dv-cinder-855350-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 11:04:26.082867 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: spawned uWSGI worker 1 (pid: 120654, cores: 1) Aug 31 11:04:26.082867 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: spawned uWSGI worker 2 (pid: 120655, cores: 1) Aug 31 11:04:26.082867 dv-cinder-855350-1-iscsi devstack@n-api.service[120635]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 11:04:26.760425 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 11:04:26.765819 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 11:04:27.937577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:04:27.937577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: from cryptography.utils import int_from_bytes Aug 31 11:04:27.938297 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:04:27.938297 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: from cryptography.utils import int_from_bytes Aug 31 11:04:27.939177 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:04:27.939177 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: from cryptography.utils import int_from_bytes Aug 31 11:04:27.939655 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:04:27.939655 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: from cryptography.utils import int_from_bytes Aug 31 11:04:30.405876 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 11:04:30.406529 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 11:04:30.406673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 11:04:30.407036 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 11:04:30.407300 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 11:04:30.407621 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 11:04:30.408048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.408149 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 11:04:30.408232 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.408311 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.408463 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 11:04:30.408698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.408883 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 11:04:30.409127 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.409232 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 11:04:30.409441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.409558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.409771 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.409910 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.410339 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.410553 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.410741 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.410918 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.411168 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.411456 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.411560 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.411805 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855350-1-iscsi {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.411936 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.412178 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.412420 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.412556 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.412738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.412982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.413095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.413252 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.413351 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.413578 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.413670 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.413917 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855350-1-iscsi {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.414017 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.414244 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.414345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.414558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.414751 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.414865 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.415183 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.415270 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.415491 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.415578 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.415807 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.415896 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.416140 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.416259 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.416486 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.416636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.416783 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.416956 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.417106 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.417265 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.417415 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.417579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.417741 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.417895 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.418051 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.418209 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.418455 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855350-1-iscsi {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.418616 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.418776 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.418868 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.419089 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.419193 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.419405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.419497 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.419716 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.419820 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.420152 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.420258 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855350-1-iscsi {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.420463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.420558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.420783 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.420892 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.421095 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.421196 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.421412 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.421509 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.421739 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.421840 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.422059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.422159 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.422377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.422470 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.422696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.422792 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.423003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.423143 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.423295 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.423441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.423607 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.423755 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.423925 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.424141 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.424255 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.424348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.424561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.424665 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.424824 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.424918 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.425117 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.425215 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.425437 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.425544 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.426297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.426452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.426616 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.426794 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.426900 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.427104 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.427203 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.427421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.427521 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.427740 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.427847 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.428074 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.428172 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.428386 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.428479 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.428636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.428740 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.428888 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.428987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.429207 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.429299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.429782 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.429882 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.430133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.430285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.430396 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.430488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.430700 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.430794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.431005 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.431104 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.431310 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.431419 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.431615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.431705 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.431916 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.432039 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.432357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.432539 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.432669 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.432799 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.432898 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.433143 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.433272 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.433465 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.433562 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.433778 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.433884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.434159 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.434283 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.434466 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.434590 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.434798 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.435109 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.435320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.435495 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.435642 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.435752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.435958 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.436089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.436313 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.436407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.436655 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.436755 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.436967 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.437075 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.437215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.438362 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.438478 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.438557 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.438628 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.438706 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.438779 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.438860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.438934 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.439019 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.439092 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.439346 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.439445 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.439535 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.439619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.439698 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.439770 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.439841 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.439925 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.440202 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.440311 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.440511 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.440614 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.440815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.440920 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.441229 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.441991 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.441991 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.442288 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.442477 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.442631 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.442773 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.442950 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.443127 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.443280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.443432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.443600 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.443766 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.443916 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.444081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.444233 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.444405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.444562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.444699 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.444846 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.444999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.445157 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.445310 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.445463 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.445558 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.445714 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.445809 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.446019 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.446118 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.446323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.446415 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.446644 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.446746 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.446952 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.447049 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.447261 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.447356 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.447571 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.447671 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.447870 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.447977 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.448199 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.448294 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.448504 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.448595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.448811 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.448910 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.449116 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.449208 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.449417 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.449523 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.449721 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.449820 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.450019 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.450117 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.450324 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.450417 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.450624 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.450726 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.450927 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.451018 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.451225 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.451315 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.451525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.451620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.451829 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.451929 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.452155 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.452262 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.452458 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.452553 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.452760 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.452862 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.453061 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.453207 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.453360 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.453460 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.453677 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.453768 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.453996 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.454102 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.454309 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.454401 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.454612 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.454713 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.454913 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.455059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.455230 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:04:30.455372 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.455566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.455709 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.455882 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.455988 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.456232 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.456327 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.456542 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.456636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.456854 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.456977 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.457214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.457316 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.457626 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.457725 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.457947 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.458039 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.458263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.458363 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.458580 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.458678 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.458891 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.458983 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.459204 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.459305 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.459514 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.459612 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.459831 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.459980 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.460175 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.460322 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.460500 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.460632 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.460813 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.460917 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.461127 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.461218 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.461446 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.461539 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.461758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.461860 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.462074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.462167 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.462403 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.462502 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.462714 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.462812 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.463024 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.463125 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.463336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.463431 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.463659 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.463761 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.463991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.464132 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.464326 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.464465 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.464646 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.464747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.464956 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.465055 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.465268 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.465373 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.465578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.465679 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.465891 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.465983 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.466202 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.466302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.466513 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.466613 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.466823 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.466993 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.467173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.467391 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.467531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.467722 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.467854 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.468133 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.468449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.468768 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.469005 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.469158 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.469333 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.469495 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.469641 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.469793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.469953 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.470116 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.470269 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.470421 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.470578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.470768 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.470923 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.471075 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.471218 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.471360 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.471524 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.471681 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.471832 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.471976 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.472305 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.472460 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.472642 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.472794 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.472937 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.473079 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.473229 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.473384 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.473545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.473696 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.473848 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.473992 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.474141 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.474309 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.474464 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.474608 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.474759 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.474904 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.475046 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.475203 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.475357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.475499 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.475629 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.475766 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.475863 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.476100 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.476303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.476409 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.476623 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.476717 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.476943 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.477091 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.477387 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.477536 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.477872 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.477995 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.478154 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.478326 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.478478 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.478626 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.478782 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.478927 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.479085 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.479231 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.479378 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.479517 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.479696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.479836 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.480068 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.480395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.480722 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.480827 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.481394 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.481572 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.481722 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.481813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.481897 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.481980 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.482063 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.482261 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.482357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.482575 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.482666 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.482878 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.482969 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.483188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.483288 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.483493 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.483721 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.483813 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.484899 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.484899 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.485195 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.485320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.485404 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.485493 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.485573 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.485660 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.485754 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.485856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.485977 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.486063 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.486478 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.486631 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.486736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.486839 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.486983 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.487067 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.487243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.487347 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.487533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.487699 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.487875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.487984 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.488810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.488931 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.489053 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.489178 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.489367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.489458 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.489688 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.489781 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.490005 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.490104 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.490319 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.490433 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.490633 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.490732 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.490945 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.491043 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.491258 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.491362 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.491582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.491679 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.491895 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.491986 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.492245 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.492357 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.492556 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.492647 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.492872 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.492969 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.493175 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.493273 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.493490 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.493587 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.493828 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.493918 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.494163 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.494255 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.494481 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.494571 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.494808 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.494958 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.495116 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.495224 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.495431 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.495527 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.495744 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.495905 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.496100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.496234 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.496399 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.496540 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.496710 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.496842 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.497030 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.497164 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.497340 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.497472 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.497658 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.497798 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.497967 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.498116 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.498289 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.498421 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.498599 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.498740 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.498917 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.499050 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.499222 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.499363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.499540 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.499686 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.499868 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.500028 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.500232 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.500362 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.500541 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.500684 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.500854 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.500987 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.501174 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.501314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.501484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.501624 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.501796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.501935 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.502106 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.502237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.502412 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.502552 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.502718 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.502850 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.503027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.503160 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.503342 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.503473 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.503649 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.503786 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.504531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.504670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.504938 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.505068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.505256 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.505373 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.505569 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.505669 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.505892 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.506037 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.506201 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.506311 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.506545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.506839 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.507151 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.507391 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.507561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.507754 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.507916 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.508104 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.508253 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.508406 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.508549 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.508697 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.508846 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.509001 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.509169 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.509330 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.509480 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.509626 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.509796 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.509962 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.510113 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.510263 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.510507 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.510664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.510817 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.510997 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.511144 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.511287 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.511446 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.511580 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.511793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.511933 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.512096 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.512239 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.512369 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.512505 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.512644 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.512781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.512942 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.513084 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.513256 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.513389 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.513567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.513700 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.513877 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.514016 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.514189 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.514322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.514499 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.514632 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.514808 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.514942 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.515181 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.515322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.515459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.515595 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.515726 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.515862 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.516021 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.516257 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.516510 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.516827 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.517141 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.517438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.517608 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.517769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.517902 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.518053 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.518339 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.518472 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.518608 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.518753 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.518975 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.519116 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.519246 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.519376 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.519541 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.519680 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.519818 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.520059 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.520228 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.520373 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.520513 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.520696 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.520836 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.521015 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.521148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.521333 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.521467 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.521652 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.521785 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.521968 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.522102 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.522288 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.522421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.522608 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.522738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.522920 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.523055 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.523228 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.523369 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.523536 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.523676 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.523846 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.523986 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.524192 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.524323 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.524458 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.524597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.524755 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.525060 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.525282 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.525414 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.525541 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.525684 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.525814 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.525950 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.526079 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.526265 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.526408 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.526590 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.526738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.526899 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.527078 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.527218 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.527348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.527492 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.527622 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.527789 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.527929 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.528155 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.528291 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.528465 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.528598 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.528804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.528945 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.529115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.529245 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.529426 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.529559 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.529738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.529879 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.530048 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.530187 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.530360 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.530494 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.530668 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.530800 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.530969 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.531099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.531271 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.531403 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.531577 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.531715 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.531886 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.532038 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.532215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.532347 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.532527 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.532668 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.532835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.532965 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.533141 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.533271 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.533449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.533590 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.533751 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.533877 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.534088 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.534305 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.534444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.534583 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.534714 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.534830 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.535003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.535174 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.535385 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.535564 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.535699 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.535905 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.536084 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.536280 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.536495 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.536635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.536775 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.536911 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.537049 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.537191 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.537322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.537502 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.537642 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.537807 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.537949 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.538112 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.538253 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.538417 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.538550 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.538728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.538871 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.539037 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.539177 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.539341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.539473 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.539665 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.539811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.539974 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.540194 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.540324 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.540451 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.540592 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.540732 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.540876 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.541042 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.541182 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.541357 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.541676 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.541834 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.541973 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.542104 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.542243 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.542491 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.542622 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.542736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.542849 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.542961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.543118 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.543245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.543368 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.543575 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.543895 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.544229 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.544363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.544534 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.544839 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.545053 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.545212 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.545560 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.545728 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.545888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.546032 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.546173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.546314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.546473 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.546699 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.546854 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.547010 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.547205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.547354 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.547547 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.547697 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.547853 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.548046 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.548237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.548396 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.548539 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.548721 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.548883 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.549045 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.549196 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.549371 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.549520 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.549697 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.549846 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.550026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.550174 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.550339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.550486 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.550642 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.551334 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.551614 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.551784 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.551962 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.552148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.552332 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.552482 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.552685 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.552834 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.553011 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.553167 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.553322 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.553474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.553616 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.553765 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.553918 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.554080 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.554249 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.554653 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.554829 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.554986 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.555127 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.555282 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.555425 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.555734 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.555905 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.556083 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.556240 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.556402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.556552 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.556720 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.556942 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.557097 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.557241 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.557397 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.557541 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.557684 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.557855 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.558065 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.558227 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.558378 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.558534 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.558734 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.558893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.559043 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.559199 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.559343 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.559491 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.559662 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.559820 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.559972 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.560270 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.560422 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.560577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.560719 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.560869 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.561011 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.561161 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.561310 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.561452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.561600 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.561748 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.561905 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.562048 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.562197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.562347 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.562507 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.562650 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.562800 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.562951 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.563100 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.563399 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.563715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.563886 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.564070 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.564281 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.564439 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.564676 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.564832 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.564994 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.565147 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.565347 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.565502 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.565659 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.565950 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.566109 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.566942 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.567211 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.567211 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.567507 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.567651 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.567807 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.568115 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.568271 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.568415 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.568558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.568743 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.568904 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.569054 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.569199 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.569348 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.569497 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.569745 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.569901 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.570055 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.570198 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.570370 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.570527 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.570749 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.570905 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.571091 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.571239 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.571403 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.571560 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.571715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.571887 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.572172 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.572338 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.572489 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.572640 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.572796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.572940 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.573090 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.573241 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.573391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.573652 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.573980 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.574134 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.574287 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.574431 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.574583 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.574888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.575048 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.575227 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.575374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.575516 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.575658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.575818 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.576156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.576312 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.576524 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.576679 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.576834 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.576986 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.577243 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.577469 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.577637 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.577780 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.577921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.578071 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.578247 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.578396 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.578588 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.578738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.578922 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.579094 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.579245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.579394 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.579569 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.579728 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.579871 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.580056 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.580217 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.580486 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.580643 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.580796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.580937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.581087 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.581243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.581385 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.581540 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.581690 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.581875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.582059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.582366 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.582683 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.582841 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.582993 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.583192 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.583351 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.583502 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.583653 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.583805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.583949 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.584156 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.584404 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.584566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.584709 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.584873 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.585021 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.585171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.585314 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.585456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.585623 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.585768 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.585926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.586086 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.586392 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.586544 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.586702 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.586853 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.586997 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.587139 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.587306 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.587584 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.587745 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.587901 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.588091 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.588249 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.588435 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.588592 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.588800 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.588957 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.589193 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.589351 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.589494 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.589799 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.590107 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.590413 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.590723 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.591011 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.591167 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.591414 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.591559 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.591700 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.591922 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.592137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.592285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.592472 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.592630 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.592858 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.593006 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.593167 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.593321 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.593478 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.593667 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.593817 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.594017 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.594166 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.594355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.594506 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.594683 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.594839 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.594982 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.595135 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.595286 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.595539 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.595696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.595977 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.596171 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.596507 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.596666 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.596817 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.596817 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.597095 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.597237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.598124 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.598311 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.598456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.598602 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.598743 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.599027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.599213 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.599362 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.599546 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.599878 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.600049 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.600249 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.600451 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.600618 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.600847 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.601004 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.601148 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.601290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.601442 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.601585 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.601779 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.601928 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.602139 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.602287 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.602442 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.602586 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.602746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.602947 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.603096 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.603324 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.603475 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.603668 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.603819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.603995 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.604178 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.604357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.604680 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.604998 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.605155 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.605322 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.605467 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.605617 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.605768 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.605963 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.606228 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.606377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.606723 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.606878 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.607024 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.607167 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.607344 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.607509 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.607661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.607804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.607804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.608481 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.608626 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.608783 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.608927 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.608927 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.609208 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.609358 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.609510 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.609672 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.609817 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.609960 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.610112 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.610255 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.610397 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.610548 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.610699 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.610841 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.610990 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.611133 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.611275 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.611429 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.611592 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.611742 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.611891 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.612075 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.612275 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.612424 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.612651 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.612801 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.612983 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.613139 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.613859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.614008 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.614193 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.614344 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.614495 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.614646 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.614819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.614977 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.615129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.615280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.615429 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.615603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.615765 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.615946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.616120 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.616376 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.616536 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.616858 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.617016 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.617167 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.617309 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.617459 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.617610 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.617765 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.617908 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.617908 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.618177 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.618344 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.618674 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.618829 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.618979 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.619129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.619316 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.619465 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.619629 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.619773 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.619963 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.620189 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.620343 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.620486 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.620659 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.620810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.620953 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.621101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.621250 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.621393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.621544 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.621835 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.622146 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.622293 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.622435 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.622577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.622728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.622881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.623023 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.623259 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.623424 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.623596 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.623756 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.623899 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.624073 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.624231 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.624375 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.624594 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.624825 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.624976 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.625129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.625278 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.625420 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.625570 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.625719 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.625862 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.626003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.626178 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.626352 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.626592 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.626739 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.627064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.627211 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.627372 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.627531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.627674 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.627815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.627815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.628130 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.628275 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.628425 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.628750 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.629425 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.629578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.629578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.629877 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.630029 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.630174 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.630316 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.630465 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.630610 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.630760 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.630916 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.631068 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.631219 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.631369 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.631606 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.631764 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.631917 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.632095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.632298 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.632456 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.632634 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.632790 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.632940 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.633090 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.633418 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.633575 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.633754 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.633905 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.634081 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.634232 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.634405 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.634553 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.634728 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.634885 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.635108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.635257 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.635399 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.635549 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.635700 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.635871 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.636125 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.636287 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.636441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.636604 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.636865 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.637217 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.637370 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.637522 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.637664 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.637820 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.638086 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.638086 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.638436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.638592 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.638946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.639106 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.639106 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.639423 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.639579 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.639722 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.639879 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.639879 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.640198 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.640342 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.640342 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.640633 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.640784 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.640928 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.641077 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.641228 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.641378 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.641520 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.641672 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.641813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.641963 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.642106 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.642247 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.642396 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.642558 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.642702 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.642849 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.642998 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.643146 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.643297 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.643452 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.643594 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.643735 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.643876 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.644088 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.644258 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.644474 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.645124 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.645270 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.645420 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.645569 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.645870 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.646076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.646408 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.646576 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.646730 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.646896 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.647171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.647448 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.647615 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.647766 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.647912 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.648092 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.648256 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.648406 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.648557 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.648718 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.648880 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.649230 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.649383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.649525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.649678 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.649828 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.649972 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.649972 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.650257 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.650400 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.650541 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.650682 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.650837 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.650983 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.651132 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.651281 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.651422 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.651574 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.651724 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.651873 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.652043 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.652213 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.652357 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.652497 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.652647 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.652797 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.652939 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.653080 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.653250 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.653410 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.653566 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.653786 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.653942 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.654099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.654249 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.654405 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.654547 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.654713 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.654861 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.655010 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.655150 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.655301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.655460 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.655610 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.655752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.655893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.656119 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.656357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.656597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.656745 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.656894 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.657037 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.657277 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.657455 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.657686 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.657851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.658002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.658152 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.658308 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.658460 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.658610 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.658764 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.658915 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.659083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.659083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.659542 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.659694 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.659694 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.659989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.660203 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.660493 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.660805 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.661140 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.661458 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.661771 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.662082 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.662244 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.662389 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.662580 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.662745 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.662932 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.663096 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.663289 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.663446 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.663611 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.663792 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.663940 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.664180 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.664330 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.664521 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.664670 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.664860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.665017 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.665180 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.665322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.665463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.665605 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.665791 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.666104 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.666259 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.666402 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.666545 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.666804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.666951 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.667104 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.667380 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.667535 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.667696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.667943 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.668140 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.668296 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.668438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.668581 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.668723 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.668866 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.669023 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.669185 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.669543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.669715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.669873 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.670025 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.670183 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.670341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.670505 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.670663 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.670814 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.670970 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.671133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.671282 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.671479 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.671643 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.671800 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.671951 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.672139 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.672291 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.672291 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.672582 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.672731 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.672887 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.673038 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 11:04:30.673188 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.673336 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.673593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.674076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.674412 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.674922 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.675330 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.675736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.675962 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.676462 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.677027 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.677027 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.677335 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.677613 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.677997 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.678266 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.678741 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.679152 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.679884 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.680137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.680468 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.680802 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.681121 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.681453 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.681794 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.682114 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.682600 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.682927 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.683269 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.683620 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.684101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.684344 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.684665 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.684982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.685298 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.685617 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.685951 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.686340 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.686662 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.686993 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.687289 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.687662 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.687912 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.688251 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.688650 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.688903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.689265 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.689519 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.689843 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.690164 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.690439 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.690750 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.691068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.691923 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.692282 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.694008 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.694008 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.694008 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.694008 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.694791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.694791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.694791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.695247 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.695403 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.695659 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.695992 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.696429 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.696765 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.697132 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.697408 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.697807 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.698047 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.698369 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.698893 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.699124 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.699455 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.699789 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.700247 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.700448 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.700790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.701116 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.701448 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.701801 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.702236 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.702469 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.702960 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.703290 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.703611 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.703934 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.704283 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.704667 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.704926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.705246 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.705572 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.705896 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.706240 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.706642 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.707541 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.707935 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.708444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.708747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.709073 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.709520 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.709813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.710139 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.710511 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.710829 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:04:30.711080 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 11:04:30.734728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO dbcounter [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Registered counter for database nova_api Aug 31 11:04:30.756473 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_db.sqlalchemy.engines [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:04:30.766011 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writer thread running {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:04:30.780342 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO dbcounter [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Registered counter for database nova_api Aug 31 11:04:30.805958 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_db.sqlalchemy.engines [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:04:30.813079 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writer thread running {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:04:30.826796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.context [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),113279e0-ed70-4e73-b063-0d2b7c31aff4(cell1) {{(pid=120654) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 11:04:30.831110 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:04:30.831594 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:04:30.833991 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:04:30.834706 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:04:30.835173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:04:30.837263 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:04:30.839328 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO dbcounter [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Registered counter for database nova_cell0 Aug 31 11:04:30.843737 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO dbcounter [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Registered counter for database nova_cell1 Aug 31 11:04:30.851564 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_db.sqlalchemy.engines [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:04:30.852707 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_db.sqlalchemy.engines [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:04:30.859909 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writer thread running {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:04:30.861262 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writer thread running {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:04:30.871423 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.context [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),113279e0-ed70-4e73-b063-0d2b7c31aff4(cell1) {{(pid=120655) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 11:04:30.875501 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:04:30.875978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:04:30.877597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:04:30.878346 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:04:30.879525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:04:30.881522 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:04:30.883550 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO dbcounter [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Registered counter for database nova_cell0 Aug 31 11:04:30.887601 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO dbcounter [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Registered counter for database nova_cell1 Aug 31 11:04:30.895796 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_db.sqlalchemy.engines [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:04:30.897727 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_db.sqlalchemy.engines [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:04:30.903491 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writer thread running {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:04:30.906111 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writer thread running {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:04:31.011910 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO dbcounter [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Registered counter for database nova_cell0 Aug 31 11:04:31.018779 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_db.sqlalchemy.engines [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:04:31.023451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writer thread running {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:04:31.052926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO dbcounter [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Registered counter for database nova_cell0 Aug 31 11:04:31.059905 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_db.sqlalchemy.engines [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:04:31.064431 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writer thread running {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:04:31.367570 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: WARNING keystonemiddleware.auth_token [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 11:04:31.375345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: WARNING keystonemiddleware.auth_token [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 11:04:31.418942 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: WARNING keystonemiddleware.auth_token [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 11:04:31.430177 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: WARNING keystonemiddleware.auth_token [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 11:04:31.756612 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: WARNING keystonemiddleware.auth_token [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 11:04:31.762851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: WARNING keystonemiddleware.auth_token [None req-7814ab73-f056-4bb1-8496-517201530aaf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 11:04:31.768215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56164aa7d9c0 pid: 120654 (default app) Aug 31 11:04:31.807010 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: WARNING keystonemiddleware.auth_token [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 11:04:31.813089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: WARNING keystonemiddleware.auth_token [None req-ad95d3eb-a5bf-40bf-a2c2-49c9a8932fc4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 11:04:31.819380 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56164aa7d9c0 pid: 120655 (default app) Aug 31 11:05:14.276864 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=3 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:14.279215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=3 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:14.281856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=3 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:14.289168 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=3 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:14.589865 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-144c9597-cfa3-4d32-affd-8d0579b00138 tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] Calling method '.version_select at 0x7f732e39faf0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:15.164745 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-144c9597-cfa3-4d32-affd-8d0579b00138 tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/75802024-eab6-44ff-9d57-9be4b0da6215" status: 200 len: 351 microversion: 2.1 time: 0.896034 Aug 31 11:05:15.165518 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 1/1] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:05:14 2022] GET /compute/v2.1/os-volumes/75802024-eab6-44ff-9d57-9be4b0da6215 => generated 351 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:17.220214 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=3 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:17.221887 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=3 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:17.223623 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=3 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:17.225818 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=3 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:17.613257 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7354ea76-6ea3-4cdd-8f98-2028fb2174ca tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] Calling method '.version_select at 0x7f732e39faf0>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:18.363130 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7354ea76-6ea3-4cdd-8f98-2028fb2174ca tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d8dc72ce-3cc5-4231-b100-587f5ae262f0" status: 200 len: 351 microversion: 2.1 time: 1.149873 Aug 31 11:05:18.364500 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:05:17 2022] GET /compute/v2.1/os-volumes/d8dc72ce-3cc5-4231-b100-587f5ae262f0 => generated 351 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:20.295918 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b5c31eee-83ac-40db-990f-26331d5b58ba tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] Calling method '.version_select at 0x7f732e26aca0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:20.386617 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b5c31eee-83ac-40db-990f-26331d5b58ba tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7a3afcae-233b-433d-9214-bea73c3af643" status: 200 len: 348 microversion: 2.1 time: 0.094511 Aug 31 11:05:20.387673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:05:20 2022] GET /compute/v2.1/os-volumes/7a3afcae-233b-433d-9214-bea73c3af643 => generated 348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:20.401199 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9061510a-f6e2-4ef0-8825-461803491e1c tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] Calling method '.version_select at 0x7f732e26ac10>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:20.521940 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-9061510a-f6e2-4ef0-8825-461803491e1c tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.125127 Aug 31 11:05:20.522781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1134 bytes} [Wed Aug 31 11:05:20 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:20.537322 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-05b1d8b4-ff3f-4111-ad64-2fa1926223bd tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] Calling method '.version_select at 0x7f732e22d3a0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:20.705926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-05b1d8b4-ff3f-4111-ad64-2fa1926223bd tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.173166 Aug 31 11:05:20.714446 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Aug 31 11:05:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:20.724801 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-399415a7-d542-400f-9901-00072c3d467c tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] Calling method '.version_select at 0x7f732e48aa60>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:21.075437 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-399415a7-d542-400f-9901-00072c3d467c tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.359462 Aug 31 11:05:21.076852 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1134 bytes} [Wed Aug 31 11:05:20 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:21.091058 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7569bd8c-6390-4e18-83de-3c49685f36e7 tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] Calling method '.version_select at 0x7f732e26aaf0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:21.368344 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7569bd8c-6390-4e18-83de-3c49685f36e7 tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.282363 Aug 31 11:05:21.381434 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1167 bytes} [Wed Aug 31 11:05:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:21.385616 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-fc3f5b12-6c42-4b1b-a118-1c5d690131a8 tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] Calling method '.version_select at 0x7f732e23e1f0>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:21.625416 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-fc3f5b12-6c42-4b1b-a118-1c5d690131a8 tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.244931 Aug 31 11:05:21.627392 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Aug 31 11:05:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:21.642826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8334e874-6127-436d-a520-3f239ab59947 tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] Calling method '.version_select at 0x7f732e243ca0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:21.944028 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8334e874-6127-436d-a520-3f239ab59947 tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.305980 Aug 31 11:05:21.952401 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Aug 31 11:05:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:21.960536 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-35d337d0-972a-4532-8051-fe15b8af0891 tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] Calling method '.version_select at 0x7f732e23e9d0>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:22.203645 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-35d337d0-972a-4532-8051-fe15b8af0891 tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.246870 Aug 31 11:05:22.204727 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1188 bytes} [Wed Aug 31 11:05:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:22.220881 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-94466557-06d9-42ce-9109-d66717cc432d tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] Calling method '.version_select at 0x7f732e22d310>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:22.554283 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-94466557-06d9-42ce-9109-d66717cc432d tempest-VolumesTestJSON-1655237516 tempest-VolumesTestJSON-1655237516-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.339583 Aug 31 11:05:22.555108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Aug 31 11:05:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:25.576314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-22c71501-84a0-47e7-9157-f1ae56aa2924 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: .version_select at 0x7f732e2278b0>, body: {"keypair": {"name": "tempest-keypair-636628674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNEYSlMwVC3qLvV3sVX6fr8UtMZ4kgG69qju+FqzKqdpiFJ3DJtAkQ6DsSuE0wLL7Or7qCkdjS9E054mb/+L7iZ1RG4pPU/yIn/EZkQrlZ8aYc4HEencA+FbWbciExe6Q=="}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:25.716393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-22c71501-84a0-47e7-9157-f1ae56aa2924 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:05:25.730054 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-22c71501-84a0-47e7-9157-f1ae56aa2924 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for user d0e5dae087184c56b1cb72fb7705d4d5 and project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:05:25.825732 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-22c71501-84a0-47e7-9157-f1ae56aa2924 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.786349 Aug 31 11:05:25.826381 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 6/12] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 11:05:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:28.887822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-698694461", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:29.192241 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] validate_networks() for [('5115a138-f5d9-41a5-9c7a-63c215e1254a', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:05:29.459400 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1750418540", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "networks": [{"uuid": "ea790519-468a-4dbc-851c-f6cc79b1c373"}]}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:29.701373 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.network.neutron [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] validate_networks() for [('ea790519-468a-4dbc-851c-f6cc79b1c373', None, None, None, None, None)] {{(pid=120655) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:05:34.246299 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Flavor limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:05:34.247389 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Image limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:05:34.247929 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Flavor pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:05:34.248588 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Image pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:05:34.249209 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:05:34.266214 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:34.270166 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:34.272226 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:34.273179 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:34.275542 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:34.276093 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:34.340201 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Getting quotas for project 0ee7c5a0b37b4192a3746ee760ecefa5. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:05:34.346651 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Getting quotas for user 0517d50b405e4bce991bb22eef6076a4 and project 0ee7c5a0b37b4192a3746ee760ecefa5. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:05:34.382389 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Going to run 1 instances... {{(pid=120655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:05:34.388067 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:05:34.491474 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:05:34.492224 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:05:34.492688 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:05:34.493411 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:05:34.493561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:05:34.522018 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:34.527447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:34.528208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:34.529039 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:34.529507 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:34.529927 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:34.568235 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-2afe57a4-ffb4-4c96-86ac-0a295b81db6b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.352531 Aug 31 11:05:34.569673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 7/13] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 5355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:05:34.589582 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1519613987", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6f1d69a-015b-48c6-bbc4-eabba1f958e8"}], "security_groups": [{"name": "tempest-securitygroup--1690638242"}], "key_name": "tempest-keypair-636628674", "user_data": "}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:34.616060 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Getting quotas for project 9ceec51e430e4a00b407068a2243be63. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:05:34.633569 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Getting quotas for user 19643be9952649aba81e61d5d55290c4 and project 9ceec51e430e4a00b407068a2243be63. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:05:34.658141 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:05:34.661743 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:05:34.820767 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1a535cd9-f13d-49f0-b62a-7691d9e370be tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.404013 Aug 31 11:05:34.822662 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 7/14] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:05:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 6408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:05:34.841835 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1cf9a7c4-96f7-4298-a4ff-961104791bb7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:34.844134 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1cf9a7c4-96f7-4298-a4ff-961104791bb7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:35.146042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-1cf9a7c4-96f7-4298-a4ff-961104791bb7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:35.206536 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1cf9a7c4-96f7-4298-a4ff-961104791bb7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1215 microversion: 2.1 time: 0.375445 Aug 31 11:05:35.213888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:34 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1215 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:35.236194 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2946a948-4007-4b67-82c1-c4e148928ce6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:35.242806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2946a948-4007-4b67-82c1-c4e148928ce6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:35.339696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2946a948-4007-4b67-82c1-c4e148928ce6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:35.350099 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2946a948-4007-4b67-82c1-c4e148928ce6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1221 microversion: 2.1 time: 0.133647 Aug 31 11:05:35.351959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:35 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1221 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:35.819256 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.network.neutron [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] validate_networks() for [('b6f1d69a-015b-48c6-bbc4-eabba1f958e8', None, None, None, None, None)] {{(pid=120655) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:05:36.063822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1139871422", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:36.255254 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] validate_networks() for [('5115a138-f5d9-41a5-9c7a-63c215e1254a', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:05:38.000810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Flavor limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:05:38.001807 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Image limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:05:38.002458 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Flavor pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:05:38.003174 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Image pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:05:38.004259 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:05:38.015068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:38.016213 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:38.017373 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:38.018339 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:38.019067 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:38.019936 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:38.066248 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:05:38.083472 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for user d0e5dae087184c56b1cb72fb7705d4d5 and project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:05:38.143244 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Going to run 1 instances... {{(pid=120655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:05:38.148896 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:05:38.178067 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:05:38.178917 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:05:38.179065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:05:38.179531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:05:38.180322 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:05:38.208395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:38.209503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:38.216325 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:38.220630 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:38.223696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:38.224668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:38.362372 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-493005fa-2c18-41db-99ac-a67275bd9533 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.791118 Aug 31 11:05:38.363145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 8/17] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:05:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 3793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:05:38.370649 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-69d2334e-4f86-4cd2-8b53-d5e21812af9a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:38.379538 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Getting quotas for project 9ceec51e430e4a00b407068a2243be63. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:05:38.379940 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-69d2334e-4f86-4cd2-8b53-d5e21812af9a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:38.385668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Getting quotas for user 19643be9952649aba81e61d5d55290c4 and project 9ceec51e430e4a00b407068a2243be63. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:05:38.419122 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:05:38.428917 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:05:38.441807 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-69d2334e-4f86-4cd2-8b53-d5e21812af9a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:38.442332 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-69d2334e-4f86-4cd2-8b53-d5e21812af9a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:38.449379 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-69d2334e-4f86-4cd2-8b53-d5e21812af9a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:38.450395 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-69d2334e-4f86-4cd2-8b53-d5e21812af9a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:38.451024 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-69d2334e-4f86-4cd2-8b53-d5e21812af9a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:38.451614 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-69d2334e-4f86-4cd2-8b53-d5e21812af9a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:38.526859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7b896824-9a1a-4990-a4e6-555648b783da tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.469399 Aug 31 11:05:38.527522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 10/18] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:05:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 11:05:38.543477 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-df2623d8-b663-40b6-ae31-c6e80de4e201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:38.544135 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-df2623d8-b663-40b6-ae31-c6e80de4e201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:38.854095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-df2623d8-b663-40b6-ae31-c6e80de4e201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:38.867570 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-df2623d8-b663-40b6-ae31-c6e80de4e201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1241 microversion: 2.1 time: 0.327427 Aug 31 11:05:38.873774 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 11/19] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:38 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1241 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:38.906823 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-558698db-e285-4a18-b0ad-18a3cd83d5ce tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:38.907625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-558698db-e285-4a18-b0ad-18a3cd83d5ce tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:39.052601 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-558698db-e285-4a18-b0ad-18a3cd83d5ce tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:39.086669 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-558698db-e285-4a18-b0ad-18a3cd83d5ce tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1222 microversion: 2.1 time: 0.211768 Aug 31 11:05:39.103196 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 12/20] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:38 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1222 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:39.382534 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-69d2334e-4f86-4cd2-8b53-d5e21812af9a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:39.475721 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-69d2334e-4f86-4cd2-8b53-d5e21812af9a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1267 microversion: 2.1 time: 1.109204 Aug 31 11:05:39.480713 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 9/21] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:38 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1267 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:39.651137 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f1ce2171-1fb7-488a-9462-1e8affdb9fb1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Action: 'create', calling method: .version_select at 0x7f732d8ffd30>, body: {"keypair": {"name": "tempest-keypair-1887607971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVy6T6X0SsSsKFA5LUpAYxmWFrswOCi7/OxL8N1SXku5Lbuyk4+E/tcdvuDPOsjAR8gyjpt80atHAQql5td/9w28KflcWl/x9C35jqg708HEaQkJEJEn2CP5DpkzYo2iA=="}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:39.860646 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-f1ce2171-1fb7-488a-9462-1e8affdb9fb1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Getting quotas for project a25cd48f364541dbaceabdac555bb343. Resources: {'key_pairs'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:05:39.901359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f964ea1a-cdb5-4c3d-ab5f-c736883b001f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:39.901993 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-f964ea1a-cdb5-4c3d-ab5f-c736883b001f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:39.906467 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-f1ce2171-1fb7-488a-9462-1e8affdb9fb1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Getting quotas for user 714872990c384663bcd564cd5b9ae432 and project a25cd48f364541dbaceabdac555bb343. Resources: {'key_pairs'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:05:40.064324 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f1ce2171-1fb7-488a-9462-1e8affdb9fb1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.957854 Aug 31 11:05:40.066216 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 13/22] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Aug 31 11:05:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 962 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 11:05:40.134214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-eb91dbde-03a0-4cdd-a6f1-0742d2b22b5e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:40.134656 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-eb91dbde-03a0-4cdd-a6f1-0742d2b22b5e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:40.184695 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-f964ea1a-cdb5-4c3d-ab5f-c736883b001f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:40.213708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-f964ea1a-cdb5-4c3d-ab5f-c736883b001f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1241 microversion: 2.1 time: 0.318909 Aug 31 11:05:40.234733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 10/23] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:39 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1241 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:05:40.512858 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-56d614e6-d0a0-4d80-acde-3409f072770b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:40.514150 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-56d614e6-d0a0-4d80-acde-3409f072770b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:40.525068 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-eb91dbde-03a0-4cdd-a6f1-0742d2b22b5e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:40.550236 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-56d614e6-d0a0-4d80-acde-3409f072770b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:40.565132 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-56d614e6-d0a0-4d80-acde-3409f072770b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:40.566937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-56d614e6-d0a0-4d80-acde-3409f072770b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:40.570638 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-56d614e6-d0a0-4d80-acde-3409f072770b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:40.572869 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-56d614e6-d0a0-4d80-acde-3409f072770b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:40.580535 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-56d614e6-d0a0-4d80-acde-3409f072770b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:40.582021 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-eb91dbde-03a0-4cdd-a6f1-0742d2b22b5e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1222 microversion: 2.1 time: 0.453999 Aug 31 11:05:40.600668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 14/24] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:40 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1222 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:41.246472 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-bebc7b11-1cbb-40be-b093-38e8f98d9830 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:41.247962 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-bebc7b11-1cbb-40be-b093-38e8f98d9830 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:41.275394 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bebc7b11-1cbb-40be-b093-38e8f98d9830 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:41.275794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bebc7b11-1cbb-40be-b093-38e8f98d9830 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:41.284557 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bebc7b11-1cbb-40be-b093-38e8f98d9830 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:41.285617 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bebc7b11-1cbb-40be-b093-38e8f98d9830 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:41.289131 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bebc7b11-1cbb-40be-b093-38e8f98d9830 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:41.289903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bebc7b11-1cbb-40be-b093-38e8f98d9830 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:41.311326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-56d614e6-d0a0-4d80-acde-3409f072770b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:41.386049 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-56d614e6-d0a0-4d80-acde-3409f072770b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1273 microversion: 2.1 time: 0.882951 Aug 31 11:05:41.392677 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 11/25] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:40 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1273 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:05:41.661615 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-fc0119ee-7c86-489e-80a9-3a763080c829 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:41.668474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-fc0119ee-7c86-489e-80a9-3a763080c829 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:41.741732 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fc0119ee-7c86-489e-80a9-3a763080c829 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:41.748034 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fc0119ee-7c86-489e-80a9-3a763080c829 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:41.752829 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fc0119ee-7c86-489e-80a9-3a763080c829 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:41.757877 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fc0119ee-7c86-489e-80a9-3a763080c829 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:41.762609 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fc0119ee-7c86-489e-80a9-3a763080c829 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:41.765751 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fc0119ee-7c86-489e-80a9-3a763080c829 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:41.847631 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-bebc7b11-1cbb-40be-b093-38e8f98d9830 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:41.868051 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-bebc7b11-1cbb-40be-b093-38e8f98d9830 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1293 microversion: 2.1 time: 0.628855 Aug 31 11:05:41.873739 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 15/26] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:41 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1293 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:05:42.033018 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-fc0119ee-7c86-489e-80a9-3a763080c829 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:42.059123 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-fc0119ee-7c86-489e-80a9-3a763080c829 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1274 microversion: 2.1 time: 0.424210 Aug 31 11:05:42.067051 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 12/27] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:41 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1274 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:05:42.417922 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-31e42a10-7fac-4386-874f-ed13988ef8b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:42.418911 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-31e42a10-7fac-4386-874f-ed13988ef8b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:42.454357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-31e42a10-7fac-4386-874f-ed13988ef8b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:42.455816 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-31e42a10-7fac-4386-874f-ed13988ef8b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:42.457112 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-31e42a10-7fac-4386-874f-ed13988ef8b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:42.458665 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-31e42a10-7fac-4386-874f-ed13988ef8b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:42.472394 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-31e42a10-7fac-4386-874f-ed13988ef8b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:42.473471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-31e42a10-7fac-4386-874f-ed13988ef8b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:42.907254 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-794582e7-a169-4e5c-a5fb-27561551929a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:42.908904 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-794582e7-a169-4e5c-a5fb-27561551929a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:42.922884 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-794582e7-a169-4e5c-a5fb-27561551929a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:42.924624 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-794582e7-a169-4e5c-a5fb-27561551929a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:42.927107 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-794582e7-a169-4e5c-a5fb-27561551929a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:42.932185 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-794582e7-a169-4e5c-a5fb-27561551929a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:42.933063 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-794582e7-a169-4e5c-a5fb-27561551929a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:42.939106 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-794582e7-a169-4e5c-a5fb-27561551929a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:43.670901 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-794582e7-a169-4e5c-a5fb-27561551929a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:43.690953 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-794582e7-a169-4e5c-a5fb-27561551929a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1311 microversion: 2.1 time: 0.787657 Aug 31 11:05:43.694092 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 13/28] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:42 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1311 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:43.708459 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-88ff0835-4303-4758-9ca1-90213003d6ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:43.719896 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-88ff0835-4303-4758-9ca1-90213003d6ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:43.743678 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-88ff0835-4303-4758-9ca1-90213003d6ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:43.751796 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-88ff0835-4303-4758-9ca1-90213003d6ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:43.754735 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-88ff0835-4303-4758-9ca1-90213003d6ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:43.758403 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-88ff0835-4303-4758-9ca1-90213003d6ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:43.761966 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-88ff0835-4303-4758-9ca1-90213003d6ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:43.762533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-88ff0835-4303-4758-9ca1-90213003d6ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:44.202770 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-31e42a10-7fac-4386-874f-ed13988ef8b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:44.238646 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-31e42a10-7fac-4386-874f-ed13988ef8b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 1.827974 Aug 31 11:05:44.241444 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 16/29] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:42 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:44.634063 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-88ff0835-4303-4758-9ca1-90213003d6ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:44.659810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-88ff0835-4303-4758-9ca1-90213003d6ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1280 microversion: 2.1 time: 0.958380 Aug 31 11:05:44.663766 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 14/30] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:43 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1280 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:44.725747 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-dee5f1b7-c6b4-4610-8734-6bbadf277201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:44.744026 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-dee5f1b7-c6b4-4610-8734-6bbadf277201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:44.778501 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dee5f1b7-c6b4-4610-8734-6bbadf277201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:44.788801 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dee5f1b7-c6b4-4610-8734-6bbadf277201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:44.797761 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dee5f1b7-c6b4-4610-8734-6bbadf277201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:44.799964 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dee5f1b7-c6b4-4610-8734-6bbadf277201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:44.802374 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dee5f1b7-c6b4-4610-8734-6bbadf277201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:44.803761 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dee5f1b7-c6b4-4610-8734-6bbadf277201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:45.274341 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cfdce397-dbbf-441b-921d-b9293540009c tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:45.274976 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-cfdce397-dbbf-441b-921d-b9293540009c tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:45.305781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cfdce397-dbbf-441b-921d-b9293540009c tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:45.306387 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cfdce397-dbbf-441b-921d-b9293540009c tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:45.306842 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cfdce397-dbbf-441b-921d-b9293540009c tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:45.307591 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cfdce397-dbbf-441b-921d-b9293540009c tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:45.308080 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cfdce397-dbbf-441b-921d-b9293540009c tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:45.308516 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cfdce397-dbbf-441b-921d-b9293540009c tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:45.369508 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-dee5f1b7-c6b4-4610-8734-6bbadf277201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:45.390941 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-dee5f1b7-c6b4-4610-8734-6bbadf277201 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1299 microversion: 2.1 time: 0.679847 Aug 31 11:05:45.391590 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 17/31] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:44 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1299 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:45.706722 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4c3b6ab3-ab68-44ea-8157-420b305549ac tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:45.707452 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4c3b6ab3-ab68-44ea-8157-420b305549ac tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:45.745928 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c3b6ab3-ab68-44ea-8157-420b305549ac tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:45.746750 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c3b6ab3-ab68-44ea-8157-420b305549ac tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:45.748409 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c3b6ab3-ab68-44ea-8157-420b305549ac tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:45.753589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c3b6ab3-ab68-44ea-8157-420b305549ac tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:45.754352 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c3b6ab3-ab68-44ea-8157-420b305549ac tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:45.754963 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c3b6ab3-ab68-44ea-8157-420b305549ac tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:46.025681 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4c3b6ab3-ab68-44ea-8157-420b305549ac tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:46.038034 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4c3b6ab3-ab68-44ea-8157-420b305549ac tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1280 microversion: 2.1 time: 0.339255 Aug 31 11:05:46.047439 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 18/32] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:45 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1280 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:46.413374 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a235e2cd-7ccb-4b3e-82f1-b176c935a891 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:46.414114 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a235e2cd-7ccb-4b3e-82f1-b176c935a891 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:46.426036 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a235e2cd-7ccb-4b3e-82f1-b176c935a891 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:46.436611 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a235e2cd-7ccb-4b3e-82f1-b176c935a891 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:46.442907 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a235e2cd-7ccb-4b3e-82f1-b176c935a891 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:46.443935 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a235e2cd-7ccb-4b3e-82f1-b176c935a891 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:46.445146 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a235e2cd-7ccb-4b3e-82f1-b176c935a891 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:46.445594 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a235e2cd-7ccb-4b3e-82f1-b176c935a891 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:46.891466 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a235e2cd-7ccb-4b3e-82f1-b176c935a891 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:46.923345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a235e2cd-7ccb-4b3e-82f1-b176c935a891 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1299 microversion: 2.1 time: 0.514857 Aug 31 11:05:46.923947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 19/33] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:46 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1299 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:05:47.060864 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-54573830-1858-40d2-a674-21e132ea3e75 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:47.061828 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-54573830-1858-40d2-a674-21e132ea3e75 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:47.076848 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-54573830-1858-40d2-a674-21e132ea3e75 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:47.077746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-54573830-1858-40d2-a674-21e132ea3e75 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:47.078754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-54573830-1858-40d2-a674-21e132ea3e75 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:47.079665 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-54573830-1858-40d2-a674-21e132ea3e75 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:47.098193 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-54573830-1858-40d2-a674-21e132ea3e75 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:47.099950 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-54573830-1858-40d2-a674-21e132ea3e75 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:47.251062 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-54573830-1858-40d2-a674-21e132ea3e75 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:47.267092 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-54573830-1858-40d2-a674-21e132ea3e75 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1280 microversion: 2.1 time: 0.210671 Aug 31 11:05:47.268069 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 20/34] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:47 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1280 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:47.947838 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-51e898c4-7ece-444e-96f5-e9720a8d8f34 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:47.949449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-51e898c4-7ece-444e-96f5-e9720a8d8f34 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:47.975226 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-51e898c4-7ece-444e-96f5-e9720a8d8f34 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:47.975741 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-51e898c4-7ece-444e-96f5-e9720a8d8f34 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:47.985009 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-51e898c4-7ece-444e-96f5-e9720a8d8f34 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:48.000356 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-51e898c4-7ece-444e-96f5-e9720a8d8f34 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:48.002099 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-51e898c4-7ece-444e-96f5-e9720a8d8f34 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:48.003232 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-51e898c4-7ece-444e-96f5-e9720a8d8f34 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:48.036892 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=4 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:48.280357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=4 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:48.658299 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-cfdce397-dbbf-441b-921d-b9293540009c tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:48.698889 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-cfdce397-dbbf-441b-921d-b9293540009c tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 3.428677 Aug 31 11:05:48.700505 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 15/35] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:45 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 3432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:48.737953 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-115d87f5-94f7-4077-9673-dbb03984d8d8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:48.739237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-115d87f5-94f7-4077-9673-dbb03984d8d8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:48.769677 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:48.780761 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-115d87f5-94f7-4077-9673-dbb03984d8d8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:48.782132 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-115d87f5-94f7-4077-9673-dbb03984d8d8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:48.782953 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-115d87f5-94f7-4077-9673-dbb03984d8d8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:48.784669 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-115d87f5-94f7-4077-9673-dbb03984d8d8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:48.785648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-115d87f5-94f7-4077-9673-dbb03984d8d8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:48.786445 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-115d87f5-94f7-4077-9673-dbb03984d8d8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:49.912165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-115d87f5-94f7-4077-9673-dbb03984d8d8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:49.942905 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-115d87f5-94f7-4077-9673-dbb03984d8d8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 1.237501 Aug 31 11:05:49.943532 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 16/36] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:48 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:49.957919 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-29b4a06d-01b6-4bb5-98d1-e63c1ed1c0b4 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:49.961673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-29b4a06d-01b6-4bb5-98d1-e63c1ed1c0b4 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:49.983952 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-29b4a06d-01b6-4bb5-98d1-e63c1ed1c0b4 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:49.996265 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-29b4a06d-01b6-4bb5-98d1-e63c1ed1c0b4 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:49.997024 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-29b4a06d-01b6-4bb5-98d1-e63c1ed1c0b4 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:49.999460 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-29b4a06d-01b6-4bb5-98d1-e63c1ed1c0b4 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:50.000731 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-29b4a06d-01b6-4bb5-98d1-e63c1ed1c0b4 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:50.002626 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-29b4a06d-01b6-4bb5-98d1-e63c1ed1c0b4 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:50.198410 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=18 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:50.539426 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=26 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:50.588134 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-51e898c4-7ece-444e-96f5-e9720a8d8f34 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:50.612626 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-51e898c4-7ece-444e-96f5-e9720a8d8f34 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 2.669033 Aug 31 11:05:50.618487 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 21/37] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:47 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 2676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:50.972544 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c9449691-ee61-4b42-85b4-aaad5e0c3c02 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:50.974808 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c9449691-ee61-4b42-85b4-aaad5e0c3c02 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:50.993697 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c9449691-ee61-4b42-85b4-aaad5e0c3c02 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:50.998523 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c9449691-ee61-4b42-85b4-aaad5e0c3c02 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:51.000532 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c9449691-ee61-4b42-85b4-aaad5e0c3c02 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:51.005522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c9449691-ee61-4b42-85b4-aaad5e0c3c02 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:51.008789 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c9449691-ee61-4b42-85b4-aaad5e0c3c02 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:51.010951 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c9449691-ee61-4b42-85b4-aaad5e0c3c02 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:51.101260 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-29b4a06d-01b6-4bb5-98d1-e63c1ed1c0b4 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:51.128659 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-29b4a06d-01b6-4bb5-98d1-e63c1ed1c0b4 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 1.180676 Aug 31 11:05:51.130597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 17/38] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:49 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:51.607876 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c9449691-ee61-4b42-85b4-aaad5e0c3c02 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:51.618072 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c9449691-ee61-4b42-85b4-aaad5e0c3c02 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.652954 Aug 31 11:05:51.620261 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 22/39] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:50 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:51.645208 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-18fe2852-5ecd-4394-872a-90529e42186d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:51.646338 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-18fe2852-5ecd-4394-872a-90529e42186d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:51.655304 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-18fe2852-5ecd-4394-872a-90529e42186d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:51.660075 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-18fe2852-5ecd-4394-872a-90529e42186d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:51.660883 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-18fe2852-5ecd-4394-872a-90529e42186d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:51.663721 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-18fe2852-5ecd-4394-872a-90529e42186d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:51.664495 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-18fe2852-5ecd-4394-872a-90529e42186d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:51.665173 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-18fe2852-5ecd-4394-872a-90529e42186d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:51.946865 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-47bb1b0f-ad4b-4176-8afb-9adb3f3a6de0 req-5f7e545c-99f2-44de-aa12-49e0fb964314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc9445a-04e3-40f8-a633-1a8cfa00c35e", "tag": "06e3aac7-5227-4820-84b2-1723e967b4d6"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:51.976318 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-47bb1b0f-ad4b-4176-8afb-9adb3f3a6de0 req-5f7e545c-99f2-44de-aa12-49e0fb964314 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:51.977812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-47bb1b0f-ad4b-4176-8afb-9adb3f3a6de0 req-5f7e545c-99f2-44de-aa12-49e0fb964314 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:51.982136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-47bb1b0f-ad4b-4176-8afb-9adb3f3a6de0 req-5f7e545c-99f2-44de-aa12-49e0fb964314 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:52.026678 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-47bb1b0f-ad4b-4176-8afb-9adb3f3a6de0 req-5f7e545c-99f2-44de-aa12-49e0fb964314 service nova] Creating event network-changed:06e3aac7-5227-4820-84b2-1723e967b4d6 for instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e on hv-cinder-85535 Aug 31 11:05:52.027703 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-47bb1b0f-ad4b-4176-8afb-9adb3f3a6de0 req-5f7e545c-99f2-44de-aa12-49e0fb964314 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120654) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 11:05:52.028836 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-47bb1b0f-ad4b-4176-8afb-9adb3f3a6de0 req-5f7e545c-99f2-44de-aa12-49e0fb964314 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120654) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 11:05:52.031451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c7dd018-8717-4e46-9a78-7f9fdb39bea0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:52.034785 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c7dd018-8717-4e46-9a78-7f9fdb39bea0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:52.036833 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c7dd018-8717-4e46-9a78-7f9fdb39bea0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:52.038710 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c7dd018-8717-4e46-9a78-7f9fdb39bea0 None None] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:52.039600 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c7dd018-8717-4e46-9a78-7f9fdb39bea0 None None] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:52.040309 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c7dd018-8717-4e46-9a78-7f9fdb39bea0 None None] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:52.067404 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.compute.rpcapi [None req-2c7dd018-8717-4e46-9a78-7f9fdb39bea0 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 11:05:52.071164 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c7dd018-8717-4e46-9a78-7f9fdb39bea0 None None] Releasing lock "compute-rpcapi-router" {{(pid=120654) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 11:05:52.113997 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2c7dd018-8717-4e46-9a78-7f9fdb39bea0 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249588 Aug 31 11:05:52.117056 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 23/40] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:05:52.177646 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a4a420fd-d488-462f-8a6d-0fb65fff0b36 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:52.178937 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a4a420fd-d488-462f-8a6d-0fb65fff0b36 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:52.193081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a4a420fd-d488-462f-8a6d-0fb65fff0b36 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:52.193895 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a4a420fd-d488-462f-8a6d-0fb65fff0b36 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:52.194874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a4a420fd-d488-462f-8a6d-0fb65fff0b36 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:52.196237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a4a420fd-d488-462f-8a6d-0fb65fff0b36 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:52.196941 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a4a420fd-d488-462f-8a6d-0fb65fff0b36 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:52.197691 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a4a420fd-d488-462f-8a6d-0fb65fff0b36 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:52.474580 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-18fe2852-5ecd-4394-872a-90529e42186d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:52.496402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-18fe2852-5ecd-4394-872a-90529e42186d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.855257 Aug 31 11:05:52.499730 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 18/41] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:51 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:52.531891 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a4a420fd-d488-462f-8a6d-0fb65fff0b36 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:52.544040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a4a420fd-d488-462f-8a6d-0fb65fff0b36 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.375329 Aug 31 11:05:52.544847 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 24/42] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:52 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:05:52.649470 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e5162bbc-28d8-4738-8089-01c9200a7bfa tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:52.650101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e5162bbc-28d8-4738-8089-01c9200a7bfa tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:52.665403 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e5162bbc-28d8-4738-8089-01c9200a7bfa tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:52.665926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e5162bbc-28d8-4738-8089-01c9200a7bfa tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:52.666385 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e5162bbc-28d8-4738-8089-01c9200a7bfa tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:52.673861 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e5162bbc-28d8-4738-8089-01c9200a7bfa tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:52.679810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e5162bbc-28d8-4738-8089-01c9200a7bfa tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:52.680387 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e5162bbc-28d8-4738-8089-01c9200a7bfa tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:53.063316 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2106524607", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81f6ee16-a0fc-484a-ac35-afb225d1c49b"}], "security_groups": [{"name": "tempest-securitygroup--1408431149"}], "key_name": "tempest-keypair-1887607971", "user_data": "}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:53.288619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] validate_networks() for [('81f6ee16-a0fc-484a-ac35-afb225d1c49b', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:05:53.333289 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e5162bbc-28d8-4738-8089-01c9200a7bfa tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:53.348514 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e5162bbc-28d8-4738-8089-01c9200a7bfa tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.701574 Aug 31 11:05:53.351113 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 19/43] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:52 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:53.526707 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f3e6a6fb-ed6d-4966-af73-1119a170e131 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:53.528322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-f3e6a6fb-ed6d-4966-af73-1119a170e131 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:53.538499 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f3e6a6fb-ed6d-4966-af73-1119a170e131 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:53.539010 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f3e6a6fb-ed6d-4966-af73-1119a170e131 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:53.539470 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f3e6a6fb-ed6d-4966-af73-1119a170e131 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:53.540242 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f3e6a6fb-ed6d-4966-af73-1119a170e131 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:53.540691 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f3e6a6fb-ed6d-4966-af73-1119a170e131 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:53.541124 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f3e6a6fb-ed6d-4966-af73-1119a170e131 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:53.728580 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-f3e6a6fb-ed6d-4966-af73-1119a170e131 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:53.741257 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-f3e6a6fb-ed6d-4966-af73-1119a170e131 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.219094 Aug 31 11:05:53.741929 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 20/44] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:53 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:05:53.746824 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0f65a01a-abc5-4ea4-b096-6c2e0d1d43c6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:53.747644 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0f65a01a-abc5-4ea4-b096-6c2e0d1d43c6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:53.755734 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f65a01a-abc5-4ea4-b096-6c2e0d1d43c6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:53.756663 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f65a01a-abc5-4ea4-b096-6c2e0d1d43c6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:53.757110 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f65a01a-abc5-4ea4-b096-6c2e0d1d43c6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:53.757817 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f65a01a-abc5-4ea4-b096-6c2e0d1d43c6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:53.758420 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f65a01a-abc5-4ea4-b096-6c2e0d1d43c6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:53.759004 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f65a01a-abc5-4ea4-b096-6c2e0d1d43c6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:54.007048 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0f65a01a-abc5-4ea4-b096-6c2e0d1d43c6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:54.046607 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0f65a01a-abc5-4ea4-b096-6c2e0d1d43c6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.300552 Aug 31 11:05:54.050220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 21/45] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:53 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:54.435255 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-f25805cf-31c1-4b2f-ad57-8334ce750942 req-41d8f58e-64af-47c6-82b8-e5ca8e1c600e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a53db1-1075-4ae2-a541-fdf0936c6809", "tag": "bb6a3c4e-f4e5-4304-9b95-f2f8786d83ac"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:54.490544 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-f25805cf-31c1-4b2f-ad57-8334ce750942 req-41d8f58e-64af-47c6-82b8-e5ca8e1c600e service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:54.494014 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-f25805cf-31c1-4b2f-ad57-8334ce750942 req-41d8f58e-64af-47c6-82b8-e5ca8e1c600e service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:54.495972 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-f25805cf-31c1-4b2f-ad57-8334ce750942 req-41d8f58e-64af-47c6-82b8-e5ca8e1c600e service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:54.602396 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-f25805cf-31c1-4b2f-ad57-8334ce750942 req-41d8f58e-64af-47c6-82b8-e5ca8e1c600e service nova] Creating event network-changed:bb6a3c4e-f4e5-4304-9b95-f2f8786d83ac for instance 50a53db1-1075-4ae2-a541-fdf0936c6809 on hv-cinder-85535 Aug 31 11:05:54.603128 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-f25805cf-31c1-4b2f-ad57-8334ce750942 req-41d8f58e-64af-47c6-82b8-e5ca8e1c600e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120655) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 11:05:54.614202 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-f25805cf-31c1-4b2f-ad57-8334ce750942 req-41d8f58e-64af-47c6-82b8-e5ca8e1c600e service nova] Acquired lock "compute-rpcapi-router" {{(pid=120655) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 11:05:54.622315 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e959916a-261f-4c1f-8d11-e78f0a29a1b6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:54.625599 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e959916a-261f-4c1f-8d11-e78f0a29a1b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:54.628120 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e959916a-261f-4c1f-8d11-e78f0a29a1b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:54.634334 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e959916a-261f-4c1f-8d11-e78f0a29a1b6 None None] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:54.638227 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e959916a-261f-4c1f-8d11-e78f0a29a1b6 None None] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:54.639389 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e959916a-261f-4c1f-8d11-e78f0a29a1b6 None None] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:54.693253 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.compute.rpcapi [None req-e959916a-261f-4c1f-8d11-e78f0a29a1b6 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 11:05:54.697101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e959916a-261f-4c1f-8d11-e78f0a29a1b6 None None] Releasing lock "compute-rpcapi-router" {{(pid=120655) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 11:05:54.739592 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e959916a-261f-4c1f-8d11-e78f0a29a1b6 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.685379 Aug 31 11:05:54.740514 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 22/46] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:54.757506 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-f088c59f-9386-4e5b-8c7e-2e0235e8f561 req-35f2e39a-8786-49fb-a0b0-ef6b66b04095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef326a6-422d-46ab-8437-92751363027e", "tag": "959bd8f8-d3e0-4f32-b288-fb014d4a28cd"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:54.786619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-f088c59f-9386-4e5b-8c7e-2e0235e8f561 req-35f2e39a-8786-49fb-a0b0-ef6b66b04095 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:54.787942 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-f088c59f-9386-4e5b-8c7e-2e0235e8f561 req-35f2e39a-8786-49fb-a0b0-ef6b66b04095 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:54.790554 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-f088c59f-9386-4e5b-8c7e-2e0235e8f561 req-35f2e39a-8786-49fb-a0b0-ef6b66b04095 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:54.828271 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-f088c59f-9386-4e5b-8c7e-2e0235e8f561 req-35f2e39a-8786-49fb-a0b0-ef6b66b04095 service nova] Creating event network-changed:959bd8f8-d3e0-4f32-b288-fb014d4a28cd for instance 5ef326a6-422d-46ab-8437-92751363027e on hv-cinder-85535 Aug 31 11:05:54.841593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-f088c59f-9386-4e5b-8c7e-2e0235e8f561 req-35f2e39a-8786-49fb-a0b0-ef6b66b04095 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097296 Aug 31 11:05:54.848097 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 23/47] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:54.865472 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-57269d13-09f2-4143-89b3-4c17f3780a2d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:54.868480 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-57269d13-09f2-4143-89b3-4c17f3780a2d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:54.888773 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57269d13-09f2-4143-89b3-4c17f3780a2d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:54.891106 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57269d13-09f2-4143-89b3-4c17f3780a2d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:54.892737 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57269d13-09f2-4143-89b3-4c17f3780a2d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:54.896817 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57269d13-09f2-4143-89b3-4c17f3780a2d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:54.899544 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57269d13-09f2-4143-89b3-4c17f3780a2d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:54.900222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57269d13-09f2-4143-89b3-4c17f3780a2d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:55.416051 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:05:55.423252 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:05:55.425834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:05:55.427247 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:05:55.436431 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:05:55.482682 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:55.484624 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:55.485769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:55.486615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:55.487077 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:55.487578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:55.536103 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Getting quotas for project a25cd48f364541dbaceabdac555bb343. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:05:55.545421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Getting quotas for user 714872990c384663bcd564cd5b9ae432 and project a25cd48f364541dbaceabdac555bb343. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:05:55.606595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:05:55.614584 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:05:55.672687 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:55.789032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-da81bc05-0639-4978-8e83-20392ed53c17 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.731907 Aug 31 11:05:55.793796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 25/48] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Aug 31 11:05:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 2737 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 11:05:55.810387 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-db467bb3-39b0-4c93-bb88-3add09650704 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:55.814096 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-db467bb3-39b0-4c93-bb88-3add09650704 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:55.822267 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-db467bb3-39b0-4c93-bb88-3add09650704 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:55.826926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-db467bb3-39b0-4c93-bb88-3add09650704 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:55.827753 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-db467bb3-39b0-4c93-bb88-3add09650704 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:55.829666 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-db467bb3-39b0-4c93-bb88-3add09650704 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:55.830616 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-db467bb3-39b0-4c93-bb88-3add09650704 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:55.832873 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-db467bb3-39b0-4c93-bb88-3add09650704 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:56.286910 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-db467bb3-39b0-4c93-bb88-3add09650704 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:56.301540 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-db467bb3-39b0-4c93-bb88-3add09650704 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.498640 Aug 31 11:05:56.302521 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 26/49] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:55 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:56.352539 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3bdb726b-337c-47e6-a041-cabb5ce6d332 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:56.353683 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3bdb726b-337c-47e6-a041-cabb5ce6d332 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:56.393890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3bdb726b-337c-47e6-a041-cabb5ce6d332 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:56.395050 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3bdb726b-337c-47e6-a041-cabb5ce6d332 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:56.396502 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3bdb726b-337c-47e6-a041-cabb5ce6d332 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:56.400650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3bdb726b-337c-47e6-a041-cabb5ce6d332 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:56.401388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3bdb726b-337c-47e6-a041-cabb5ce6d332 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:56.402707 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3bdb726b-337c-47e6-a041-cabb5ce6d332 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:57.766798 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-57269d13-09f2-4143-89b3-4c17f3780a2d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:57.799529 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-57269d13-09f2-4143-89b3-4c17f3780a2d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 2.949382 Aug 31 11:05:57.808089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 24/50] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:54 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 2959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:57.865354 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9b6b53a7-2fc7-475d-b3f6-6953626d3a86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:57.866529 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-9b6b53a7-2fc7-475d-b3f6-6953626d3a86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:57.877078 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3bdb726b-337c-47e6-a041-cabb5ce6d332 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:57.896478 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3bdb726b-337c-47e6-a041-cabb5ce6d332 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 1.550973 Aug 31 11:05:57.900299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 27/51] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:56 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:57.907121 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9b6b53a7-2fc7-475d-b3f6-6953626d3a86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:57.907933 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9b6b53a7-2fc7-475d-b3f6-6953626d3a86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:57.911742 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9b6b53a7-2fc7-475d-b3f6-6953626d3a86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:57.915879 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9b6b53a7-2fc7-475d-b3f6-6953626d3a86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:57.925982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9b6b53a7-2fc7-475d-b3f6-6953626d3a86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:57.926988 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9b6b53a7-2fc7-475d-b3f6-6953626d3a86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:57.927273 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-d776050a-47a1-4b05-af0f-08f295090a07 req-18e9882b-c971-4bb6-8fcd-1c3d6d8825a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9af9ee9-af17-4f68-bb4a-dcebd9827b12", "tag": "2270adbc-f6f1-4f49-bcf6-15ac3f4a262a"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:58.005297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-d776050a-47a1-4b05-af0f-08f295090a07 req-18e9882b-c971-4bb6-8fcd-1c3d6d8825a6 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:58.008355 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-d776050a-47a1-4b05-af0f-08f295090a07 req-18e9882b-c971-4bb6-8fcd-1c3d6d8825a6 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:58.012136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-d776050a-47a1-4b05-af0f-08f295090a07 req-18e9882b-c971-4bb6-8fcd-1c3d6d8825a6 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:58.098983 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-d776050a-47a1-4b05-af0f-08f295090a07 req-18e9882b-c971-4bb6-8fcd-1c3d6d8825a6 service nova] Creating event network-changed:2270adbc-f6f1-4f49-bcf6-15ac3f4a262a for instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 on hv-cinder-85535 Aug 31 11:05:58.150440 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-d776050a-47a1-4b05-af0f-08f295090a07 req-18e9882b-c971-4bb6-8fcd-1c3d6d8825a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239834 Aug 31 11:05:58.152296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 28/52] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:58.206770 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1faadc0a-bb01-4a1c-837d-eb52a54a5eaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:58.218553 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1faadc0a-bb01-4a1c-837d-eb52a54a5eaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:58.274238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1faadc0a-bb01-4a1c-837d-eb52a54a5eaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:58.279360 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1faadc0a-bb01-4a1c-837d-eb52a54a5eaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:58.282977 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1faadc0a-bb01-4a1c-837d-eb52a54a5eaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:58.286777 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1faadc0a-bb01-4a1c-837d-eb52a54a5eaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:58.297549 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1faadc0a-bb01-4a1c-837d-eb52a54a5eaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:58.299946 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1faadc0a-bb01-4a1c-837d-eb52a54a5eaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:58.312865 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-9b6b53a7-2fc7-475d-b3f6-6953626d3a86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:58.403433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-9b6b53a7-2fc7-475d-b3f6-6953626d3a86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:58.414931 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-9b6b53a7-2fc7-475d-b3f6-6953626d3a86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:58.434095 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-9b6b53a7-2fc7-475d-b3f6-6953626d3a86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1286 microversion: 2.20 time: 0.595546 Aug 31 11:05:58.460512 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 25/53] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:05:57 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1286 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:05:58.564648 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=79 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:58.854328 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f4393d2a-6656-4541-afcb-28f699d2142f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:58.858809 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-f4393d2a-6656-4541-afcb-28f699d2142f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:58.912483 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f4393d2a-6656-4541-afcb-28f699d2142f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:58.913997 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f4393d2a-6656-4541-afcb-28f699d2142f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:58.918667 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f4393d2a-6656-4541-afcb-28f699d2142f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:58.919613 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f4393d2a-6656-4541-afcb-28f699d2142f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:58.922294 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f4393d2a-6656-4541-afcb-28f699d2142f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:58.923941 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f4393d2a-6656-4541-afcb-28f699d2142f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:59.448433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-f4393d2a-6656-4541-afcb-28f699d2142f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:59.458519 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=99 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:59.462610 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-f4393d2a-6656-4541-afcb-28f699d2142f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.615617 Aug 31 11:05:59.463908 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 26/54] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:58 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:59.472403 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4e276d24-dfd5-4e0a-b008-d667d75b6056 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:59.481501 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-4e276d24-dfd5-4e0a-b008-d667d75b6056 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:59.492618 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4e276d24-dfd5-4e0a-b008-d667d75b6056 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:59.493099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4e276d24-dfd5-4e0a-b008-d667d75b6056 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:59.493907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4e276d24-dfd5-4e0a-b008-d667d75b6056 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:59.494848 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4e276d24-dfd5-4e0a-b008-d667d75b6056 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:59.495506 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4e276d24-dfd5-4e0a-b008-d667d75b6056 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:59.496210 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4e276d24-dfd5-4e0a-b008-d667d75b6056 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:59.632246 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-1faadc0a-bb01-4a1c-837d-eb52a54a5eaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:59.643081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1faadc0a-bb01-4a1c-837d-eb52a54a5eaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 1.480837 Aug 31 11:05:59.643984 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 29/55] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:58 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:59.660665 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6d7df641-6459-4acb-b093-7476ca1ffb79 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:59.661427 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6d7df641-6459-4acb-b093-7476ca1ffb79 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:59.668318 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d7df641-6459-4acb-b093-7476ca1ffb79 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:59.668811 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d7df641-6459-4acb-b093-7476ca1ffb79 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:59.669244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d7df641-6459-4acb-b093-7476ca1ffb79 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:59.670123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d7df641-6459-4acb-b093-7476ca1ffb79 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:59.671571 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d7df641-6459-4acb-b093-7476ca1ffb79 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:59.672067 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d7df641-6459-4acb-b093-7476ca1ffb79 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:59.726469 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4e276d24-dfd5-4e0a-b008-d667d75b6056 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:59.736628 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4e276d24-dfd5-4e0a-b008-d667d75b6056 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.270954 Aug 31 11:05:59.746869 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 27/56] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:59 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:59.768130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6d7df641-6459-4acb-b093-7476ca1ffb79 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:59.797053 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6d7df641-6459-4acb-b093-7476ca1ffb79 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:59.798999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6d7df641-6459-4acb-b093-7476ca1ffb79 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:59.800461 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6d7df641-6459-4acb-b093-7476ca1ffb79 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1334 microversion: 2.20 time: 0.155051 Aug 31 11:05:59.808560 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 30/57] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:05:59 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1334 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:00.488639 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-059f9bb5-bf68-4f45-8e21-dad1d06ae4a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:00.490365 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-059f9bb5-bf68-4f45-8e21-dad1d06ae4a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:00.503414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-059f9bb5-bf68-4f45-8e21-dad1d06ae4a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:00.504116 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-059f9bb5-bf68-4f45-8e21-dad1d06ae4a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:00.504957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-059f9bb5-bf68-4f45-8e21-dad1d06ae4a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:00.506179 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-059f9bb5-bf68-4f45-8e21-dad1d06ae4a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:00.506933 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-059f9bb5-bf68-4f45-8e21-dad1d06ae4a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:00.507926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-059f9bb5-bf68-4f45-8e21-dad1d06ae4a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:00.665472 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5b6362f1-3547-48c4-bbb4-37014537b142 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:00.666518 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5b6362f1-3547-48c4-bbb4-37014537b142 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:00.673212 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b6362f1-3547-48c4-bbb4-37014537b142 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:00.673703 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b6362f1-3547-48c4-bbb4-37014537b142 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:00.674140 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b6362f1-3547-48c4-bbb4-37014537b142 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:00.675263 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b6362f1-3547-48c4-bbb4-37014537b142 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:00.675830 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b6362f1-3547-48c4-bbb4-37014537b142 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:00.676313 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b6362f1-3547-48c4-bbb4-37014537b142 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:00.755102 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-059f9bb5-bf68-4f45-8e21-dad1d06ae4a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:00.774630 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-059f9bb5-bf68-4f45-8e21-dad1d06ae4a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.292049 Aug 31 11:06:00.793686 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 28/58] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:00 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:00.813318 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-fcff7a7b-8de1-4fcc-b3b9-b7381870275f tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:00.815412 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-fcff7a7b-8de1-4fcc-b3b9-b7381870275f tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:00.828540 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fcff7a7b-8de1-4fcc-b3b9-b7381870275f tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:00.830344 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fcff7a7b-8de1-4fcc-b3b9-b7381870275f tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:00.831697 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fcff7a7b-8de1-4fcc-b3b9-b7381870275f tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:00.833223 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fcff7a7b-8de1-4fcc-b3b9-b7381870275f tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:00.834578 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fcff7a7b-8de1-4fcc-b3b9-b7381870275f tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:00.835550 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fcff7a7b-8de1-4fcc-b3b9-b7381870275f tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:00.949591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-5b6362f1-3547-48c4-bbb4-37014537b142 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:00.964809 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-5b6362f1-3547-48c4-bbb4-37014537b142 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.303225 Aug 31 11:06:00.980118 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:00 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:00.985976 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3f2d9083-ca9c-40be-9e61-3a5d3ad2a86d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:00.986901 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3f2d9083-ca9c-40be-9e61-3a5d3ad2a86d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:00.992986 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3f2d9083-ca9c-40be-9e61-3a5d3ad2a86d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:00.993735 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3f2d9083-ca9c-40be-9e61-3a5d3ad2a86d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:00.994336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3f2d9083-ca9c-40be-9e61-3a5d3ad2a86d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:00.995063 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3f2d9083-ca9c-40be-9e61-3a5d3ad2a86d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:00.995509 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3f2d9083-ca9c-40be-9e61-3a5d3ad2a86d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:00.996123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3f2d9083-ca9c-40be-9e61-3a5d3ad2a86d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:01.082205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3f2d9083-ca9c-40be-9e61-3a5d3ad2a86d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:01.096719 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3f2d9083-ca9c-40be-9e61-3a5d3ad2a86d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:01.098934 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3f2d9083-ca9c-40be-9e61-3a5d3ad2a86d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:01.099413 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-fcff7a7b-8de1-4fcc-b3b9-b7381870275f tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:01.100286 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3f2d9083-ca9c-40be-9e61-3a5d3ad2a86d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1342 microversion: 2.20 time: 0.119017 Aug 31 11:06:01.112837 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 32/60] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:00 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1342 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:01.126453 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-fcff7a7b-8de1-4fcc-b3b9-b7381870275f tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.330513 Aug 31 11:06:01.127491 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 29/61] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:00 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:01.811999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-26ba12fa-c2bd-406b-9891-09565e84d3bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:01.813321 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-26ba12fa-c2bd-406b-9891-09565e84d3bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:01.819695 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-26ba12fa-c2bd-406b-9891-09565e84d3bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:01.820509 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-26ba12fa-c2bd-406b-9891-09565e84d3bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:01.821704 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-26ba12fa-c2bd-406b-9891-09565e84d3bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:01.822676 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-26ba12fa-c2bd-406b-9891-09565e84d3bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:01.823365 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-26ba12fa-c2bd-406b-9891-09565e84d3bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:01.823963 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-26ba12fa-c2bd-406b-9891-09565e84d3bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:01.995982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a0637310-3b3d-4d4e-a16e-ca605bc65739 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:02.000059 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a0637310-3b3d-4d4e-a16e-ca605bc65739 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:02.011627 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0637310-3b3d-4d4e-a16e-ca605bc65739 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:02.013185 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0637310-3b3d-4d4e-a16e-ca605bc65739 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:02.014688 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0637310-3b3d-4d4e-a16e-ca605bc65739 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:02.015859 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0637310-3b3d-4d4e-a16e-ca605bc65739 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:02.016816 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0637310-3b3d-4d4e-a16e-ca605bc65739 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:02.018122 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0637310-3b3d-4d4e-a16e-ca605bc65739 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:02.061808 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-26ba12fa-c2bd-406b-9891-09565e84d3bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:02.080225 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-26ba12fa-c2bd-406b-9891-09565e84d3bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.272759 Aug 31 11:06:02.085348 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 33/62] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:01 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:02.122841 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-af1494f3-b493-4353-b02e-ad74a2d3de3e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:02.124672 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-af1494f3-b493-4353-b02e-ad74a2d3de3e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:02.131171 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-af1494f3-b493-4353-b02e-ad74a2d3de3e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:02.131948 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-af1494f3-b493-4353-b02e-ad74a2d3de3e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:02.132459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-af1494f3-b493-4353-b02e-ad74a2d3de3e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:02.133198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-af1494f3-b493-4353-b02e-ad74a2d3de3e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:02.133922 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-af1494f3-b493-4353-b02e-ad74a2d3de3e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:02.134574 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-af1494f3-b493-4353-b02e-ad74a2d3de3e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:02.238702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-af1494f3-b493-4353-b02e-ad74a2d3de3e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:02.256415 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a0637310-3b3d-4d4e-a16e-ca605bc65739 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:02.273149 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a0637310-3b3d-4d4e-a16e-ca605bc65739 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.284833 Aug 31 11:06:02.273874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-af1494f3-b493-4353-b02e-ad74a2d3de3e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:02.284528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-af1494f3-b493-4353-b02e-ad74a2d3de3e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:02.284528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-af1494f3-b493-4353-b02e-ad74a2d3de3e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1340 microversion: 2.20 time: 0.164536 Aug 31 11:06:02.284528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 34/63] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:02 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1340 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:06:02.285579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 30/64] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:01 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:02.292579 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3746a4a9-57b9-465f-8770-96a351f7a38a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:02.293902 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3746a4a9-57b9-465f-8770-96a351f7a38a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:02.308215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3746a4a9-57b9-465f-8770-96a351f7a38a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:02.309549 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3746a4a9-57b9-465f-8770-96a351f7a38a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:02.310563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3746a4a9-57b9-465f-8770-96a351f7a38a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:02.313223 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3746a4a9-57b9-465f-8770-96a351f7a38a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:02.314637 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3746a4a9-57b9-465f-8770-96a351f7a38a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:02.315725 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3746a4a9-57b9-465f-8770-96a351f7a38a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:02.802895 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3746a4a9-57b9-465f-8770-96a351f7a38a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:02.821388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3746a4a9-57b9-465f-8770-96a351f7a38a tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.535881 Aug 31 11:06:02.822728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 35/65] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:02 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:03.105683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-367877af-ad35-4319-b796-3eec27c25254 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:03.106340 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-367877af-ad35-4319-b796-3eec27c25254 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:03.116634 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-367877af-ad35-4319-b796-3eec27c25254 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:03.119118 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-367877af-ad35-4319-b796-3eec27c25254 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:03.119567 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-367877af-ad35-4319-b796-3eec27c25254 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:03.121167 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-367877af-ad35-4319-b796-3eec27c25254 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:03.122012 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-367877af-ad35-4319-b796-3eec27c25254 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:03.125291 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-367877af-ad35-4319-b796-3eec27c25254 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:03.311842 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b6048849-d04f-447a-aef2-68d3404dedaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:03.312854 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b6048849-d04f-447a-aef2-68d3404dedaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:03.323229 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b6048849-d04f-447a-aef2-68d3404dedaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:03.325716 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b6048849-d04f-447a-aef2-68d3404dedaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:03.326420 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b6048849-d04f-447a-aef2-68d3404dedaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:03.328483 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b6048849-d04f-447a-aef2-68d3404dedaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:03.329159 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b6048849-d04f-447a-aef2-68d3404dedaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:03.330717 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b6048849-d04f-447a-aef2-68d3404dedaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:03.628196 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b6048849-d04f-447a-aef2-68d3404dedaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:03.638326 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b6048849-d04f-447a-aef2-68d3404dedaf tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.331407 Aug 31 11:06:03.638929 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 36/66] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:03 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:03.651765 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-00cd65ce-3a42-405a-8295-ca720a06376d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:03.653931 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-00cd65ce-3a42-405a-8295-ca720a06376d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:03.662492 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00cd65ce-3a42-405a-8295-ca720a06376d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:03.663253 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00cd65ce-3a42-405a-8295-ca720a06376d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:03.663999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00cd65ce-3a42-405a-8295-ca720a06376d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:03.664915 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00cd65ce-3a42-405a-8295-ca720a06376d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:03.665522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00cd65ce-3a42-405a-8295-ca720a06376d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:03.666134 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00cd65ce-3a42-405a-8295-ca720a06376d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:03.854843 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-00cd65ce-3a42-405a-8295-ca720a06376d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:03.875270 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-00cd65ce-3a42-405a-8295-ca720a06376d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:03.878279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-00cd65ce-3a42-405a-8295-ca720a06376d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:03.879839 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-00cd65ce-3a42-405a-8295-ca720a06376d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1340 microversion: 2.20 time: 0.239170 Aug 31 11:06:03.894192 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 37/67] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:03 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1340 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:03.905429 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1afa23c9-e772-4d58-a894-4df1b9d07b8d tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:03.906495 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1afa23c9-e772-4d58-a894-4df1b9d07b8d tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:03.914597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1afa23c9-e772-4d58-a894-4df1b9d07b8d tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:03.915419 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1afa23c9-e772-4d58-a894-4df1b9d07b8d tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:03.916287 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1afa23c9-e772-4d58-a894-4df1b9d07b8d tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:03.917471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1afa23c9-e772-4d58-a894-4df1b9d07b8d tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:03.918919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1afa23c9-e772-4d58-a894-4df1b9d07b8d tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:03.919599 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1afa23c9-e772-4d58-a894-4df1b9d07b8d tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:04.265989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-1afa23c9-e772-4d58-a894-4df1b9d07b8d tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:04.281737 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1afa23c9-e772-4d58-a894-4df1b9d07b8d tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.386196 Aug 31 11:06:04.285804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 38/68] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:03 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:04.485495 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-367877af-ad35-4319-b796-3eec27c25254 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:04.501669 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-367877af-ad35-4319-b796-3eec27c25254 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 1.398958 Aug 31 11:06:04.515501 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 31/69] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:03 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:04.682716 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b32bf862-8401-4459-8e84-94cd09087c66 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:04.683346 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b32bf862-8401-4459-8e84-94cd09087c66 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:04.693969 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b32bf862-8401-4459-8e84-94cd09087c66 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:04.694534 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b32bf862-8401-4459-8e84-94cd09087c66 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:04.695129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b32bf862-8401-4459-8e84-94cd09087c66 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:04.697891 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b32bf862-8401-4459-8e84-94cd09087c66 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:04.699166 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b32bf862-8401-4459-8e84-94cd09087c66 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:04.700128 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b32bf862-8401-4459-8e84-94cd09087c66 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:04.910261 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-2a206f67-262a-4de8-8ae9-1a9d5d2f857f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:04.911046 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-2a206f67-262a-4de8-8ae9-1a9d5d2f857f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:04.939056 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:04.942186 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2a206f67-262a-4de8-8ae9-1a9d5d2f857f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:04.943000 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2a206f67-262a-4de8-8ae9-1a9d5d2f857f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:04.943825 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2a206f67-262a-4de8-8ae9-1a9d5d2f857f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:04.953741 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2a206f67-262a-4de8-8ae9-1a9d5d2f857f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:04.954601 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2a206f67-262a-4de8-8ae9-1a9d5d2f857f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:04.955389 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2a206f67-262a-4de8-8ae9-1a9d5d2f857f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:04.995664 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b32bf862-8401-4459-8e84-94cd09087c66 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:05.031606 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b32bf862-8401-4459-8e84-94cd09087c66 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.352947 Aug 31 11:06:05.057182 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 39/70] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:04 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:05.327594 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a22c0dad-edce-45b1-8ee1-81ee876488ca tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:05.328420 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a22c0dad-edce-45b1-8ee1-81ee876488ca tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:05.336849 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a22c0dad-edce-45b1-8ee1-81ee876488ca tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:05.337346 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a22c0dad-edce-45b1-8ee1-81ee876488ca tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:05.337780 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a22c0dad-edce-45b1-8ee1-81ee876488ca tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:05.345550 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a22c0dad-edce-45b1-8ee1-81ee876488ca tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:05.346057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a22c0dad-edce-45b1-8ee1-81ee876488ca tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:05.346496 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a22c0dad-edce-45b1-8ee1-81ee876488ca tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:05.399379 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-2a206f67-262a-4de8-8ae9-1a9d5d2f857f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:05.417525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-2a206f67-262a-4de8-8ae9-1a9d5d2f857f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:05.419097 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-2a206f67-262a-4de8-8ae9-1a9d5d2f857f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:05.429746 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-2a206f67-262a-4de8-8ae9-1a9d5d2f857f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.514081 Aug 31 11:06:05.430804 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 32/71] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:04 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:05.516226 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=4 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:05.524826 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6cf8d788-1090-49fc-b414-a2e14cbf9ab9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:05.525774 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6cf8d788-1090-49fc-b414-a2e14cbf9ab9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:05.539115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6cf8d788-1090-49fc-b414-a2e14cbf9ab9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:05.539613 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6cf8d788-1090-49fc-b414-a2e14cbf9ab9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:05.540077 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6cf8d788-1090-49fc-b414-a2e14cbf9ab9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:05.548513 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6cf8d788-1090-49fc-b414-a2e14cbf9ab9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:05.549011 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6cf8d788-1090-49fc-b414-a2e14cbf9ab9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:05.549458 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6cf8d788-1090-49fc-b414-a2e14cbf9ab9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:05.591086 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=6 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:05.838550 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a22c0dad-edce-45b1-8ee1-81ee876488ca tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:05.866769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a22c0dad-edce-45b1-8ee1-81ee876488ca tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.540567 Aug 31 11:06:05.869536 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 40/72] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:05 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:05.975868 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6cf8d788-1090-49fc-b414-a2e14cbf9ab9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:06.006437 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6cf8d788-1090-49fc-b414-a2e14cbf9ab9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.485564 Aug 31 11:06:06.021365 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 33/73] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:05 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:06.098141 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-389339c3-e026-4fe8-8bc9-c2d1a0b91b7d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:06.101310 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-389339c3-e026-4fe8-8bc9-c2d1a0b91b7d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:06.127486 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-389339c3-e026-4fe8-8bc9-c2d1a0b91b7d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:06.133124 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-389339c3-e026-4fe8-8bc9-c2d1a0b91b7d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:06.136816 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-389339c3-e026-4fe8-8bc9-c2d1a0b91b7d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:06.138334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-389339c3-e026-4fe8-8bc9-c2d1a0b91b7d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:06.140725 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-389339c3-e026-4fe8-8bc9-c2d1a0b91b7d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:06.142762 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-389339c3-e026-4fe8-8bc9-c2d1a0b91b7d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:06.280266 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-74c95bff-eeb6-474a-a7bc-6cbd0f00b37b req-2661cce9-138e-4dd4-a635-9437171e4136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e", "tag": "a2414d6d-8b79-405f-a378-ffbb986542cb"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:06.334702 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-74c95bff-eeb6-474a-a7bc-6cbd0f00b37b req-2661cce9-138e-4dd4-a635-9437171e4136 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:06.335611 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-74c95bff-eeb6-474a-a7bc-6cbd0f00b37b req-2661cce9-138e-4dd4-a635-9437171e4136 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:06.341215 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-74c95bff-eeb6-474a-a7bc-6cbd0f00b37b req-2661cce9-138e-4dd4-a635-9437171e4136 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:06.403859 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-74c95bff-eeb6-474a-a7bc-6cbd0f00b37b req-2661cce9-138e-4dd4-a635-9437171e4136 service nova] Creating event network-changed:a2414d6d-8b79-405f-a378-ffbb986542cb for instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e on hv-cinder-85535 Aug 31 11:06:06.425689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-74c95bff-eeb6-474a-a7bc-6cbd0f00b37b req-2661cce9-138e-4dd4-a635-9437171e4136 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169745 Aug 31 11:06:06.433520 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 34/74] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:06:06.479367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-de3e0bb2-5031-44f7-80d6-441dd224d408 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:06.485256 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-de3e0bb2-5031-44f7-80d6-441dd224d408 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:06.512753 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de3e0bb2-5031-44f7-80d6-441dd224d408 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:06.518007 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de3e0bb2-5031-44f7-80d6-441dd224d408 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:06.518775 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de3e0bb2-5031-44f7-80d6-441dd224d408 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:06.519947 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de3e0bb2-5031-44f7-80d6-441dd224d408 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:06.520760 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de3e0bb2-5031-44f7-80d6-441dd224d408 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:06.525523 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de3e0bb2-5031-44f7-80d6-441dd224d408 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:06.532385 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-389339c3-e026-4fe8-8bc9-c2d1a0b91b7d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:06.544607 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-389339c3-e026-4fe8-8bc9-c2d1a0b91b7d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.457974 Aug 31 11:06:06.557107 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 41/75] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:06 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:06.893734 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-56c23b64-7d34-4471-a93a-230a9775b3a2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:06.894352 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-56c23b64-7d34-4471-a93a-230a9775b3a2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:06.908302 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-56c23b64-7d34-4471-a93a-230a9775b3a2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:06.908814 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-56c23b64-7d34-4471-a93a-230a9775b3a2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:06.909266 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-56c23b64-7d34-4471-a93a-230a9775b3a2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:06.915171 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-56c23b64-7d34-4471-a93a-230a9775b3a2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:06.916072 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-56c23b64-7d34-4471-a93a-230a9775b3a2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:06.916532 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-56c23b64-7d34-4471-a93a-230a9775b3a2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:07.228349 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-56c23b64-7d34-4471-a93a-230a9775b3a2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:07.239294 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-56c23b64-7d34-4471-a93a-230a9775b3a2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.351975 Aug 31 11:06:07.240627 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 42/76] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:06 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:07.259173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6a9dd11b-ac37-4f2a-9c25-6ffe8c79211d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:07.260773 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6a9dd11b-ac37-4f2a-9c25-6ffe8c79211d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:07.278251 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a9dd11b-ac37-4f2a-9c25-6ffe8c79211d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:07.279301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a9dd11b-ac37-4f2a-9c25-6ffe8c79211d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:07.281982 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a9dd11b-ac37-4f2a-9c25-6ffe8c79211d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:07.283185 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a9dd11b-ac37-4f2a-9c25-6ffe8c79211d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:07.286369 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a9dd11b-ac37-4f2a-9c25-6ffe8c79211d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:07.287517 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a9dd11b-ac37-4f2a-9c25-6ffe8c79211d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:07.517205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6a9dd11b-ac37-4f2a-9c25-6ffe8c79211d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:07.527399 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6a9dd11b-ac37-4f2a-9c25-6ffe8c79211d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.285427 Aug 31 11:06:07.529167 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 43/77] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:07 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:07.558924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-de3e0bb2-5031-44f7-80d6-441dd224d408 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:07.576528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4f85503d-f897-4136-8fe1-0fb25b652522 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:07.578717 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4f85503d-f897-4136-8fe1-0fb25b652522 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:07.584567 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-de3e0bb2-5031-44f7-80d6-441dd224d408 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:07.589024 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-de3e0bb2-5031-44f7-80d6-441dd224d408 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:07.591068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-de3e0bb2-5031-44f7-80d6-441dd224d408 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 1.120234 Aug 31 11:06:07.597413 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f85503d-f897-4136-8fe1-0fb25b652522 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:07.599297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f85503d-f897-4136-8fe1-0fb25b652522 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:07.600514 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f85503d-f897-4136-8fe1-0fb25b652522 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:07.601884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f85503d-f897-4136-8fe1-0fb25b652522 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:07.603076 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f85503d-f897-4136-8fe1-0fb25b652522 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:07.610157 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f85503d-f897-4136-8fe1-0fb25b652522 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:07.616461 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 35/78] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:06 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:06:07.860439 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4f85503d-f897-4136-8fe1-0fb25b652522 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:07.876908 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4f85503d-f897-4136-8fe1-0fb25b652522 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.309233 Aug 31 11:06:07.878229 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 44/79] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:07 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:08.319426 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-39e1b649-6517-48ee-84cf-e3692a4a342b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:08.320871 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-39e1b649-6517-48ee-84cf-e3692a4a342b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:08.355525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-39e1b649-6517-48ee-84cf-e3692a4a342b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:08.356457 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-39e1b649-6517-48ee-84cf-e3692a4a342b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:08.358563 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-39e1b649-6517-48ee-84cf-e3692a4a342b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:08.360238 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-39e1b649-6517-48ee-84cf-e3692a4a342b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:08.361336 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-39e1b649-6517-48ee-84cf-e3692a4a342b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:08.362093 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-39e1b649-6517-48ee-84cf-e3692a4a342b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:08.577686 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3889ec4a-f6b5-4d77-808f-b6dfef15e31f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:08.588430 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3889ec4a-f6b5-4d77-808f-b6dfef15e31f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:08.615369 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3889ec4a-f6b5-4d77-808f-b6dfef15e31f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:08.617683 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3889ec4a-f6b5-4d77-808f-b6dfef15e31f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:08.618523 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3889ec4a-f6b5-4d77-808f-b6dfef15e31f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:08.620899 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3889ec4a-f6b5-4d77-808f-b6dfef15e31f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:08.624778 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3889ec4a-f6b5-4d77-808f-b6dfef15e31f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:08.626886 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3889ec4a-f6b5-4d77-808f-b6dfef15e31f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:08.728572 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-39e1b649-6517-48ee-84cf-e3692a4a342b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:08.738105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-39e1b649-6517-48ee-84cf-e3692a4a342b tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.440511 Aug 31 11:06:08.741315 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 36/80] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:08 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:08.754296 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-057441e5-3121-449d-848e-5a5e5dda2cac tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:08.760623 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-057441e5-3121-449d-848e-5a5e5dda2cac tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:08.770774 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-057441e5-3121-449d-848e-5a5e5dda2cac tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:08.781914 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-057441e5-3121-449d-848e-5a5e5dda2cac tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:08.782774 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-057441e5-3121-449d-848e-5a5e5dda2cac tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:08.786268 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-057441e5-3121-449d-848e-5a5e5dda2cac tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:08.788660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-057441e5-3121-449d-848e-5a5e5dda2cac tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:08.789216 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-057441e5-3121-449d-848e-5a5e5dda2cac tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:09.189019 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3889ec4a-f6b5-4d77-808f-b6dfef15e31f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:09.193145 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=100 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:09.228945 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3889ec4a-f6b5-4d77-808f-b6dfef15e31f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.665214 Aug 31 11:06:09.258066 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 45/81] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:08 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:09.277729 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-68ff5b12-23d2-4c08-8946-be84a85fae42 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:09.282913 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-68ff5b12-23d2-4c08-8946-be84a85fae42 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:09.308322 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68ff5b12-23d2-4c08-8946-be84a85fae42 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:09.308322 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68ff5b12-23d2-4c08-8946-be84a85fae42 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:09.308778 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68ff5b12-23d2-4c08-8946-be84a85fae42 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:09.310126 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68ff5b12-23d2-4c08-8946-be84a85fae42 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:09.311668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68ff5b12-23d2-4c08-8946-be84a85fae42 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:09.315288 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68ff5b12-23d2-4c08-8946-be84a85fae42 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:09.325582 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-057441e5-3121-449d-848e-5a5e5dda2cac tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:09.345909 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-057441e5-3121-449d-848e-5a5e5dda2cac tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:09.347447 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-057441e5-3121-449d-848e-5a5e5dda2cac tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:09.357284 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-057441e5-3121-449d-848e-5a5e5dda2cac tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.604734 Aug 31 11:06:09.363633 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 37/82] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:08 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:09.533308 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-1473230a-2d45-4736-9e3c-9a11faef9694 req-4f598d07-b8ac-4dad-898a-6d9a86668d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9af9ee9-af17-4f68-bb4a-dcebd9827b12", "name": "network-vif-plugged", "status": "completed", "tag": "2270adbc-f6f1-4f49-bcf6-15ac3f4a262a"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:09.574217 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-1473230a-2d45-4736-9e3c-9a11faef9694 req-4f598d07-b8ac-4dad-898a-6d9a86668d44 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:09.578825 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-1473230a-2d45-4736-9e3c-9a11faef9694 req-4f598d07-b8ac-4dad-898a-6d9a86668d44 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:09.582408 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-1473230a-2d45-4736-9e3c-9a11faef9694 req-4f598d07-b8ac-4dad-898a-6d9a86668d44 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:09.640641 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-1473230a-2d45-4736-9e3c-9a11faef9694 req-4f598d07-b8ac-4dad-898a-6d9a86668d44 service nova] Creating event network-vif-plugged:2270adbc-f6f1-4f49-bcf6-15ac3f4a262a for instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 on hv-cinder-85535 Aug 31 11:06:09.678565 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-1473230a-2d45-4736-9e3c-9a11faef9694 req-4f598d07-b8ac-4dad-898a-6d9a86668d44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.306917 Aug 31 11:06:09.679886 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 38/83] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:06:09.711889 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-68ff5b12-23d2-4c08-8946-be84a85fae42 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:09.722355 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-68ff5b12-23d2-4c08-8946-be84a85fae42 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.462677 Aug 31 11:06:09.724366 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 46/84] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:09 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:09.771659 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-73f53301-41eb-4127-9a73-8efde2ec0e69 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:09.776237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-73f53301-41eb-4127-9a73-8efde2ec0e69 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:09.816844 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-73f53301-41eb-4127-9a73-8efde2ec0e69 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:09.818358 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-73f53301-41eb-4127-9a73-8efde2ec0e69 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:09.819978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-73f53301-41eb-4127-9a73-8efde2ec0e69 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:09.824247 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-73f53301-41eb-4127-9a73-8efde2ec0e69 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:09.826525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-73f53301-41eb-4127-9a73-8efde2ec0e69 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:09.827537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-73f53301-41eb-4127-9a73-8efde2ec0e69 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:10.274294 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-dbdcb8ef-b74a-4e5f-b830-576ac41fb1db tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:10.275282 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-dbdcb8ef-b74a-4e5f-b830-576ac41fb1db tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:10.290380 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dbdcb8ef-b74a-4e5f-b830-576ac41fb1db tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:10.295804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dbdcb8ef-b74a-4e5f-b830-576ac41fb1db tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:10.298450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dbdcb8ef-b74a-4e5f-b830-576ac41fb1db tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:10.302385 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dbdcb8ef-b74a-4e5f-b830-576ac41fb1db tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:10.307166 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dbdcb8ef-b74a-4e5f-b830-576ac41fb1db tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:10.308109 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dbdcb8ef-b74a-4e5f-b830-576ac41fb1db tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:10.359781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-73f53301-41eb-4127-9a73-8efde2ec0e69 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:10.369268 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-73f53301-41eb-4127-9a73-8efde2ec0e69 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.606786 Aug 31 11:06:10.369870 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 39/85] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:09 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:10.397184 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8f742d08-08b4-4d64-b631-89c325202f3d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:10.397900 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8f742d08-08b4-4d64-b631-89c325202f3d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:10.407260 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8f742d08-08b4-4d64-b631-89c325202f3d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:10.408386 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8f742d08-08b4-4d64-b631-89c325202f3d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:10.409457 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8f742d08-08b4-4d64-b631-89c325202f3d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:10.410548 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8f742d08-08b4-4d64-b631-89c325202f3d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:10.411264 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8f742d08-08b4-4d64-b631-89c325202f3d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:10.412182 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8f742d08-08b4-4d64-b631-89c325202f3d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:10.640392 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8f742d08-08b4-4d64-b631-89c325202f3d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:10.650158 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8f742d08-08b4-4d64-b631-89c325202f3d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:10.651624 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8f742d08-08b4-4d64-b631-89c325202f3d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:10.652778 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8f742d08-08b4-4d64-b631-89c325202f3d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.259606 Aug 31 11:06:10.665000 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 40/86] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:10 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:10.670591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-dbdcb8ef-b74a-4e5f-b830-576ac41fb1db tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:10.684276 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-dbdcb8ef-b74a-4e5f-b830-576ac41fb1db tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.414924 Aug 31 11:06:10.687923 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 47/87] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:10 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:10.762445 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a34e561b-4954-4648-a67a-5cac5584d939 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:10.764240 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a34e561b-4954-4648-a67a-5cac5584d939 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:10.771291 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a34e561b-4954-4648-a67a-5cac5584d939 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:10.771772 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a34e561b-4954-4648-a67a-5cac5584d939 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:10.772366 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a34e561b-4954-4648-a67a-5cac5584d939 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:10.776521 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a34e561b-4954-4648-a67a-5cac5584d939 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:10.776521 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a34e561b-4954-4648-a67a-5cac5584d939 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:10.776521 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a34e561b-4954-4648-a67a-5cac5584d939 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:10.984421 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a34e561b-4954-4648-a67a-5cac5584d939 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:10.994851 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a34e561b-4954-4648-a67a-5cac5584d939 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.236143 Aug 31 11:06:11.004431 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 41/88] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:10 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:11.395650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-387c28bc-e398-4944-bbe5-0f25752e9555 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:11.396967 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-387c28bc-e398-4944-bbe5-0f25752e9555 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:11.408025 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-387c28bc-e398-4944-bbe5-0f25752e9555 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:11.408783 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-387c28bc-e398-4944-bbe5-0f25752e9555 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:11.409615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-387c28bc-e398-4944-bbe5-0f25752e9555 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:11.410502 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-387c28bc-e398-4944-bbe5-0f25752e9555 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:11.411285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-387c28bc-e398-4944-bbe5-0f25752e9555 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:11.412044 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-387c28bc-e398-4944-bbe5-0f25752e9555 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:11.601769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-387c28bc-e398-4944-bbe5-0f25752e9555 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:11.611887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-387c28bc-e398-4944-bbe5-0f25752e9555 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.224459 Aug 31 11:06:11.613010 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 48/89] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:11 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:11.683264 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3e851261-f684-4d27-8907-6a203aa39bea tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:11.684418 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3e851261-f684-4d27-8907-6a203aa39bea tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:11.713619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-0765e281-3103-4908-8621-5e65a25f5717 req-4d954ad7-4584-4faa-8985-75556cb7ab44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef326a6-422d-46ab-8437-92751363027e", "name": "network-vif-plugged", "status": "completed", "tag": "959bd8f8-d3e0-4f32-b288-fb014d4a28cd"}, {"server_uuid": "fdc9445a-04e3-40f8-a633-1a8cfa00c35e", "name": "network-vif-plugged", "status": "completed", "tag": "06e3aac7-5227-4820-84b2-1723e967b4d6"}, {"server_uuid": "50a53db1-1075-4ae2-a541-fdf0936c6809", "name": "network-vif-plugged", "status": "completed", "tag": "bb6a3c4e-f4e5-4304-9b95-f2f8786d83ac"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:11.744061 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e851261-f684-4d27-8907-6a203aa39bea tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:11.749874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e851261-f684-4d27-8907-6a203aa39bea tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:11.749874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e851261-f684-4d27-8907-6a203aa39bea tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:11.749874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e851261-f684-4d27-8907-6a203aa39bea tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:11.749874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e851261-f684-4d27-8907-6a203aa39bea tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:11.750717 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e851261-f684-4d27-8907-6a203aa39bea tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:11.770901 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-0765e281-3103-4908-8621-5e65a25f5717 req-4d954ad7-4584-4faa-8985-75556cb7ab44 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:11.781065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-0765e281-3103-4908-8621-5e65a25f5717 req-4d954ad7-4584-4faa-8985-75556cb7ab44 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:11.782818 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-0765e281-3103-4908-8621-5e65a25f5717 req-4d954ad7-4584-4faa-8985-75556cb7ab44 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:11.816826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-0765e281-3103-4908-8621-5e65a25f5717 req-4d954ad7-4584-4faa-8985-75556cb7ab44 service nova] Creating event network-vif-plugged:959bd8f8-d3e0-4f32-b288-fb014d4a28cd for instance 5ef326a6-422d-46ab-8437-92751363027e on hv-cinder-85535 Aug 31 11:06:11.818619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-0765e281-3103-4908-8621-5e65a25f5717 req-4d954ad7-4584-4faa-8985-75556cb7ab44 service nova] Creating event network-vif-plugged:06e3aac7-5227-4820-84b2-1723e967b4d6 for instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e on hv-cinder-85535 Aug 31 11:06:11.819271 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-0765e281-3103-4908-8621-5e65a25f5717 req-4d954ad7-4584-4faa-8985-75556cb7ab44 service nova] Creating event network-vif-plugged:bb6a3c4e-f4e5-4304-9b95-f2f8786d83ac for instance 50a53db1-1075-4ae2-a541-fdf0936c6809 on hv-cinder-85535 Aug 31 11:06:11.830285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-0765e281-3103-4908-8621-5e65a25f5717 req-4d954ad7-4584-4faa-8985-75556cb7ab44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.125392 Aug 31 11:06:11.830285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 49/90] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:06:11.835224 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b3fb2b83-50ac-4392-b693-874462e74d7c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:11.835999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b3fb2b83-50ac-4392-b693-874462e74d7c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:11.843790 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3fb2b83-50ac-4392-b693-874462e74d7c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:11.844434 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3fb2b83-50ac-4392-b693-874462e74d7c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:11.844954 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3fb2b83-50ac-4392-b693-874462e74d7c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:11.845680 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3fb2b83-50ac-4392-b693-874462e74d7c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:11.846139 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3fb2b83-50ac-4392-b693-874462e74d7c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:11.846568 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3fb2b83-50ac-4392-b693-874462e74d7c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:12.019454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3e851261-f684-4d27-8907-6a203aa39bea tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:12.034553 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3e851261-f684-4d27-8907-6a203aa39bea tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:12.034733 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b3fb2b83-50ac-4392-b693-874462e74d7c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:12.038500 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3e851261-f684-4d27-8907-6a203aa39bea tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:12.040718 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3e851261-f684-4d27-8907-6a203aa39bea tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.365953 Aug 31 11:06:12.056813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 42/91] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:11 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:12.059905 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b3fb2b83-50ac-4392-b693-874462e74d7c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.228403 Aug 31 11:06:12.065732 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 50/92] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:11 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:12.105354 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-33acb34f-26b3-47ee-adbe-8910128f8800 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:12.106624 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-33acb34f-26b3-47ee-adbe-8910128f8800 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:12.118057 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-33acb34f-26b3-47ee-adbe-8910128f8800 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:12.118882 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-33acb34f-26b3-47ee-adbe-8910128f8800 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:12.119609 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-33acb34f-26b3-47ee-adbe-8910128f8800 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:12.120811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-33acb34f-26b3-47ee-adbe-8910128f8800 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:12.122327 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-33acb34f-26b3-47ee-adbe-8910128f8800 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:12.123095 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-33acb34f-26b3-47ee-adbe-8910128f8800 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:12.333004 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-33acb34f-26b3-47ee-adbe-8910128f8800 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:12.346263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-33acb34f-26b3-47ee-adbe-8910128f8800 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.287421 Aug 31 11:06:12.347849 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 43/93] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:12 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:12.633555 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-32caba7a-1536-454e-a755-da5ca32d9401 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:12.634162 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-32caba7a-1536-454e-a755-da5ca32d9401 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:12.641060 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32caba7a-1536-454e-a755-da5ca32d9401 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:12.641898 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32caba7a-1536-454e-a755-da5ca32d9401 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:12.642512 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32caba7a-1536-454e-a755-da5ca32d9401 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:12.643442 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32caba7a-1536-454e-a755-da5ca32d9401 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:12.643938 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32caba7a-1536-454e-a755-da5ca32d9401 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:12.644533 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32caba7a-1536-454e-a755-da5ca32d9401 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:12.863673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-32caba7a-1536-454e-a755-da5ca32d9401 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:12.879005 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-32caba7a-1536-454e-a755-da5ca32d9401 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.248143 Aug 31 11:06:12.893390 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 51/94] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:12 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:13.117666 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6f87970c-f6a5-479a-80a5-9a09e96d3b64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:13.117666 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6f87970c-f6a5-479a-80a5-9a09e96d3b64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:13.119032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5d43f83c-5a48-45ca-bed2-5ecc8927d6b6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:13.119032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5d43f83c-5a48-45ca-bed2-5ecc8927d6b6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:13.131232 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5d43f83c-5a48-45ca-bed2-5ecc8927d6b6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:13.132781 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5d43f83c-5a48-45ca-bed2-5ecc8927d6b6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:13.133793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5d43f83c-5a48-45ca-bed2-5ecc8927d6b6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:13.136259 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5d43f83c-5a48-45ca-bed2-5ecc8927d6b6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:13.139276 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5d43f83c-5a48-45ca-bed2-5ecc8927d6b6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:13.141202 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5d43f83c-5a48-45ca-bed2-5ecc8927d6b6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:13.152737 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6f87970c-f6a5-479a-80a5-9a09e96d3b64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:13.153242 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6f87970c-f6a5-479a-80a5-9a09e96d3b64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:13.153682 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6f87970c-f6a5-479a-80a5-9a09e96d3b64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:13.154429 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6f87970c-f6a5-479a-80a5-9a09e96d3b64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:13.154879 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6f87970c-f6a5-479a-80a5-9a09e96d3b64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:13.155400 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6f87970c-f6a5-479a-80a5-9a09e96d3b64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:13.575251 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-5d43f83c-5a48-45ca-bed2-5ecc8927d6b6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:13.617984 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-5d43f83c-5a48-45ca-bed2-5ecc8927d6b6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:13.627402 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-5d43f83c-5a48-45ca-bed2-5ecc8927d6b6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:13.631982 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-5d43f83c-5a48-45ca-bed2-5ecc8927d6b6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.518932 Aug 31 11:06:13.638437 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 52/95] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:13 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:13.652553 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-efd023dd-c4e9-40d5-a985-0ced9e2d87fa tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:13.657928 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-efd023dd-c4e9-40d5-a985-0ced9e2d87fa tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:13.669398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-efd023dd-c4e9-40d5-a985-0ced9e2d87fa tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:13.671594 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-efd023dd-c4e9-40d5-a985-0ced9e2d87fa tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:13.672408 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-efd023dd-c4e9-40d5-a985-0ced9e2d87fa tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:13.673672 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-efd023dd-c4e9-40d5-a985-0ced9e2d87fa tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:13.675061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-efd023dd-c4e9-40d5-a985-0ced9e2d87fa tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:13.676180 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-efd023dd-c4e9-40d5-a985-0ced9e2d87fa tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:13.860904 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6f87970c-f6a5-479a-80a5-9a09e96d3b64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:13.863442 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=100 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:13.874699 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6f87970c-f6a5-479a-80a5-9a09e96d3b64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.769502 Aug 31 11:06:13.887636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 44/96] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:13 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:13.915076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9c62736d-ef62-4785-a487-189856f890f6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:13.915901 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-9c62736d-ef62-4785-a487-189856f890f6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:13.925284 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c62736d-ef62-4785-a487-189856f890f6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:13.925764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c62736d-ef62-4785-a487-189856f890f6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:13.926412 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c62736d-ef62-4785-a487-189856f890f6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:13.927306 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c62736d-ef62-4785-a487-189856f890f6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:13.927935 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c62736d-ef62-4785-a487-189856f890f6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:13.928596 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c62736d-ef62-4785-a487-189856f890f6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:13.947375 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-efd023dd-c4e9-40d5-a985-0ced9e2d87fa tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:13.962106 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-efd023dd-c4e9-40d5-a985-0ced9e2d87fa tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.316405 Aug 31 11:06:13.963175 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 53/97] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:13 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:14.159617 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-9c62736d-ef62-4785-a487-189856f890f6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:14.175511 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-9c62736d-ef62-4785-a487-189856f890f6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.263856 Aug 31 11:06:14.176516 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 45/98] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:13 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:14.662907 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2f9f0863-de15-4e2b-adf0-cfb9aa3b1920 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:14.663680 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2f9f0863-de15-4e2b-adf0-cfb9aa3b1920 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:14.669878 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2f9f0863-de15-4e2b-adf0-cfb9aa3b1920 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:14.670531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2f9f0863-de15-4e2b-adf0-cfb9aa3b1920 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:14.671033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2f9f0863-de15-4e2b-adf0-cfb9aa3b1920 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:14.671659 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2f9f0863-de15-4e2b-adf0-cfb9aa3b1920 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:14.672186 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2f9f0863-de15-4e2b-adf0-cfb9aa3b1920 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:14.672609 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2f9f0863-de15-4e2b-adf0-cfb9aa3b1920 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:14.889372 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2f9f0863-de15-4e2b-adf0-cfb9aa3b1920 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:14.903686 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-02957d9a-0381-43fb-a033-c99420d2f8c1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:14.908076 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2f9f0863-de15-4e2b-adf0-cfb9aa3b1920 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:14.909041 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-02957d9a-0381-43fb-a033-c99420d2f8c1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:14.909591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2f9f0863-de15-4e2b-adf0-cfb9aa3b1920 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:14.910739 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2f9f0863-de15-4e2b-adf0-cfb9aa3b1920 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.251851 Aug 31 11:06:14.912576 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 54/99] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:14 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:06:14.925944 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-02957d9a-0381-43fb-a033-c99420d2f8c1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:14.926853 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-02957d9a-0381-43fb-a033-c99420d2f8c1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:14.927393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-02957d9a-0381-43fb-a033-c99420d2f8c1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:14.928247 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-02957d9a-0381-43fb-a033-c99420d2f8c1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:14.928964 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-02957d9a-0381-43fb-a033-c99420d2f8c1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:14.929584 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-02957d9a-0381-43fb-a033-c99420d2f8c1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:14.989579 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c781484e-57fe-4b69-85d0-8269b6789dc0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:14.990415 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c781484e-57fe-4b69-85d0-8269b6789dc0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:15.004142 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c781484e-57fe-4b69-85d0-8269b6789dc0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:15.004891 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c781484e-57fe-4b69-85d0-8269b6789dc0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:15.005641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c781484e-57fe-4b69-85d0-8269b6789dc0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:15.007007 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c781484e-57fe-4b69-85d0-8269b6789dc0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:15.007942 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c781484e-57fe-4b69-85d0-8269b6789dc0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:15.008728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c781484e-57fe-4b69-85d0-8269b6789dc0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:15.146679 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-02957d9a-0381-43fb-a033-c99420d2f8c1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:15.163637 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-02957d9a-0381-43fb-a033-c99420d2f8c1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.271245 Aug 31 11:06:15.173219 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 46/100] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:14 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:15.202554 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-52fccf39-d560-4d80-95c1-0e04d063de83 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:15.203271 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-52fccf39-d560-4d80-95c1-0e04d063de83 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:15.209874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-52fccf39-d560-4d80-95c1-0e04d063de83 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:15.210618 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-52fccf39-d560-4d80-95c1-0e04d063de83 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:15.211505 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-52fccf39-d560-4d80-95c1-0e04d063de83 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:15.212350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-52fccf39-d560-4d80-95c1-0e04d063de83 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:15.213061 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-52fccf39-d560-4d80-95c1-0e04d063de83 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:15.213530 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-52fccf39-d560-4d80-95c1-0e04d063de83 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:15.221686 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c781484e-57fe-4b69-85d0-8269b6789dc0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:15.233360 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c781484e-57fe-4b69-85d0-8269b6789dc0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.251489 Aug 31 11:06:15.236593 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 55/101] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:14 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:15.407265 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-52fccf39-d560-4d80-95c1-0e04d063de83 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:15.418673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-52fccf39-d560-4d80-95c1-0e04d063de83 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.224325 Aug 31 11:06:15.419710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 47/102] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:15 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:15.940110 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-54a9a255-fab8-4b2f-b91d-5a0dd68e0cbc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:15.941286 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-54a9a255-fab8-4b2f-b91d-5a0dd68e0cbc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:15.959851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-54a9a255-fab8-4b2f-b91d-5a0dd68e0cbc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:15.960446 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-54a9a255-fab8-4b2f-b91d-5a0dd68e0cbc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:15.960790 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-54a9a255-fab8-4b2f-b91d-5a0dd68e0cbc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:15.961873 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-54a9a255-fab8-4b2f-b91d-5a0dd68e0cbc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:15.963782 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-54a9a255-fab8-4b2f-b91d-5a0dd68e0cbc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:15.964469 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-54a9a255-fab8-4b2f-b91d-5a0dd68e0cbc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:16.148532 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-54a9a255-fab8-4b2f-b91d-5a0dd68e0cbc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:16.162789 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-54a9a255-fab8-4b2f-b91d-5a0dd68e0cbc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:16.166134 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-54a9a255-fab8-4b2f-b91d-5a0dd68e0cbc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:16.168716 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-54a9a255-fab8-4b2f-b91d-5a0dd68e0cbc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.235120 Aug 31 11:06:16.178890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 56/103] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:15 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:16.198598 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-42cb0940-947f-4783-aba4-2282e99fbe12 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:16.200161 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-42cb0940-947f-4783-aba4-2282e99fbe12 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:16.210049 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-42cb0940-947f-4783-aba4-2282e99fbe12 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:16.210903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-42cb0940-947f-4783-aba4-2282e99fbe12 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:16.211527 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-42cb0940-947f-4783-aba4-2282e99fbe12 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:16.213074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-42cb0940-947f-4783-aba4-2282e99fbe12 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:16.213572 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-42cb0940-947f-4783-aba4-2282e99fbe12 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:16.214856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-42cb0940-947f-4783-aba4-2282e99fbe12 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:16.272467 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-17472d04-9200-4294-a791-35b5375f9969 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:16.276899 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-17472d04-9200-4294-a791-35b5375f9969 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:16.288397 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17472d04-9200-4294-a791-35b5375f9969 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:16.289304 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17472d04-9200-4294-a791-35b5375f9969 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:16.290503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17472d04-9200-4294-a791-35b5375f9969 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:16.292417 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17472d04-9200-4294-a791-35b5375f9969 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:16.293576 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17472d04-9200-4294-a791-35b5375f9969 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:16.295168 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17472d04-9200-4294-a791-35b5375f9969 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:16.443540 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-42cb0940-947f-4783-aba4-2282e99fbe12 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:16.465226 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-42cb0940-947f-4783-aba4-2282e99fbe12 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.270645 Aug 31 11:06:16.466934 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 48/104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:16 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:16.481879 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cb2fed37-2c4d-4de7-b072-35ef115f81f1 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:16.483065 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-cb2fed37-2c4d-4de7-b072-35ef115f81f1 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:16.491905 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cb2fed37-2c4d-4de7-b072-35ef115f81f1 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:16.492822 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cb2fed37-2c4d-4de7-b072-35ef115f81f1 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:16.493448 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cb2fed37-2c4d-4de7-b072-35ef115f81f1 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:16.494167 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cb2fed37-2c4d-4de7-b072-35ef115f81f1 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:16.494623 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cb2fed37-2c4d-4de7-b072-35ef115f81f1 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:16.495039 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cb2fed37-2c4d-4de7-b072-35ef115f81f1 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:16.656419 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-17472d04-9200-4294-a791-35b5375f9969 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:16.680550 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-17472d04-9200-4294-a791-35b5375f9969 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.414623 Aug 31 11:06:16.684545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 57/105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:16 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:16.760143 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-cb2fed37-2c4d-4de7-b072-35ef115f81f1 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:16.773861 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-cb2fed37-2c4d-4de7-b072-35ef115f81f1 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.305139 Aug 31 11:06:16.774718 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 49/106] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:16 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:16.978747 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-4cd5c434-f45b-48ea-8de5-80ae7d587399 req-407b82e6-f59c-43e1-af56-90933f262b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e", "name": "network-vif-plugged", "status": "completed", "tag": "a2414d6d-8b79-405f-a378-ffbb986542cb"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:17.007784 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-4cd5c434-f45b-48ea-8de5-80ae7d587399 req-407b82e6-f59c-43e1-af56-90933f262b15 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:17.008715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-4cd5c434-f45b-48ea-8de5-80ae7d587399 req-407b82e6-f59c-43e1-af56-90933f262b15 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:17.009482 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-4cd5c434-f45b-48ea-8de5-80ae7d587399 req-407b82e6-f59c-43e1-af56-90933f262b15 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:17.031767 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-4cd5c434-f45b-48ea-8de5-80ae7d587399 req-407b82e6-f59c-43e1-af56-90933f262b15 service nova] Creating event network-vif-plugged:a2414d6d-8b79-405f-a378-ffbb986542cb for instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e on hv-cinder-85535 Aug 31 11:06:17.042521 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-4cd5c434-f45b-48ea-8de5-80ae7d587399 req-407b82e6-f59c-43e1-af56-90933f262b15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071570 Aug 31 11:06:17.043773 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 58/107] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:06:17.224678 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c3584aa5-5ac3-4eff-b10a-44bb9bc2cccd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:17.225852 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c3584aa5-5ac3-4eff-b10a-44bb9bc2cccd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:17.237406 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c3584aa5-5ac3-4eff-b10a-44bb9bc2cccd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:17.238208 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c3584aa5-5ac3-4eff-b10a-44bb9bc2cccd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:17.238978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c3584aa5-5ac3-4eff-b10a-44bb9bc2cccd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:17.240250 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c3584aa5-5ac3-4eff-b10a-44bb9bc2cccd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:17.241030 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c3584aa5-5ac3-4eff-b10a-44bb9bc2cccd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:17.241769 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c3584aa5-5ac3-4eff-b10a-44bb9bc2cccd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:17.462096 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c3584aa5-5ac3-4eff-b10a-44bb9bc2cccd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:17.472762 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c3584aa5-5ac3-4eff-b10a-44bb9bc2cccd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:17.474247 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c3584aa5-5ac3-4eff-b10a-44bb9bc2cccd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:17.475464 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c3584aa5-5ac3-4eff-b10a-44bb9bc2cccd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.260348 Aug 31 11:06:17.476060 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 50/108] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:17 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:17.491078 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9f3e88d3-3f4b-42e4-9fcb-3c6e487da7c4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:17.492212 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9f3e88d3-3f4b-42e4-9fcb-3c6e487da7c4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:17.501821 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9f3e88d3-3f4b-42e4-9fcb-3c6e487da7c4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:17.502398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9f3e88d3-3f4b-42e4-9fcb-3c6e487da7c4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:17.502924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9f3e88d3-3f4b-42e4-9fcb-3c6e487da7c4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:17.504037 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9f3e88d3-3f4b-42e4-9fcb-3c6e487da7c4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:17.504574 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9f3e88d3-3f4b-42e4-9fcb-3c6e487da7c4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:17.505277 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9f3e88d3-3f4b-42e4-9fcb-3c6e487da7c4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:17.733131 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9f3e88d3-3f4b-42e4-9fcb-3c6e487da7c4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:17.745107 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6dcab6c8-7c8b-431a-a7f9-c60741435710 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:17.746858 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6dcab6c8-7c8b-431a-a7f9-c60741435710 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:17.783131 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6dcab6c8-7c8b-431a-a7f9-c60741435710 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:17.785174 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9f3e88d3-3f4b-42e4-9fcb-3c6e487da7c4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.301129 Aug 31 11:06:17.791955 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6dcab6c8-7c8b-431a-a7f9-c60741435710 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:17.792746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 59/109] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:17 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:17.793742 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6dcab6c8-7c8b-431a-a7f9-c60741435710 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:17.801952 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6dcab6c8-7c8b-431a-a7f9-c60741435710 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:17.803180 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6dcab6c8-7c8b-431a-a7f9-c60741435710 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:17.817134 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6dcab6c8-7c8b-431a-a7f9-c60741435710 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:17.823210 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6f24411c-8dde-4299-ad3e-f43ce3beb6c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:17.829324 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6f24411c-8dde-4299-ad3e-f43ce3beb6c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:17.851794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6f24411c-8dde-4299-ad3e-f43ce3beb6c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:17.852799 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6f24411c-8dde-4299-ad3e-f43ce3beb6c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:17.854359 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6f24411c-8dde-4299-ad3e-f43ce3beb6c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:17.858204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6f24411c-8dde-4299-ad3e-f43ce3beb6c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:17.860435 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6f24411c-8dde-4299-ad3e-f43ce3beb6c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:17.861534 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6f24411c-8dde-4299-ad3e-f43ce3beb6c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:18.142669 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6f24411c-8dde-4299-ad3e-f43ce3beb6c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:18.168102 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6f24411c-8dde-4299-ad3e-f43ce3beb6c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1315 microversion: 2.1 time: 0.361320 Aug 31 11:06:18.169184 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 60/110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:17 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:18.375145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6dcab6c8-7c8b-431a-a7f9-c60741435710 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:18.406711 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6dcab6c8-7c8b-431a-a7f9-c60741435710 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1367 microversion: 2.1 time: 0.682790 Aug 31 11:06:18.428182 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 51/111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:17 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1367 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:18.502913 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e2167ee7-4ea4-487c-8d1e-60ea8c6a613f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:18.503533 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e2167ee7-4ea4-487c-8d1e-60ea8c6a613f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:18.511275 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e2167ee7-4ea4-487c-8d1e-60ea8c6a613f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:18.511763 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e2167ee7-4ea4-487c-8d1e-60ea8c6a613f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:18.512233 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e2167ee7-4ea4-487c-8d1e-60ea8c6a613f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:18.512938 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e2167ee7-4ea4-487c-8d1e-60ea8c6a613f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:18.513955 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e2167ee7-4ea4-487c-8d1e-60ea8c6a613f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:18.514691 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e2167ee7-4ea4-487c-8d1e-60ea8c6a613f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:18.812811 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e2167ee7-4ea4-487c-8d1e-60ea8c6a613f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:18.827264 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e2167ee7-4ea4-487c-8d1e-60ea8c6a613f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:18.829172 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8ea629a0-8242-4639-9d9d-8816c21029e0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:18.831543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8ea629a0-8242-4639-9d9d-8816c21029e0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:18.832222 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e2167ee7-4ea4-487c-8d1e-60ea8c6a613f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:18.833489 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e2167ee7-4ea4-487c-8d1e-60ea8c6a613f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.335018 Aug 31 11:06:18.856243 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 61/112] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:18 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:18.857615 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ea629a0-8242-4639-9d9d-8816c21029e0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:18.859200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ea629a0-8242-4639-9d9d-8816c21029e0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:18.860664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ea629a0-8242-4639-9d9d-8816c21029e0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:18.861455 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ea629a0-8242-4639-9d9d-8816c21029e0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:18.861983 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ea629a0-8242-4639-9d9d-8816c21029e0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:18.862753 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ea629a0-8242-4639-9d9d-8816c21029e0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:19.186742 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8ea629a0-8242-4639-9d9d-8816c21029e0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:19.203962 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-17a0a759-d43f-4f71-a76f-ba8c60a627fe tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:19.205003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-17a0a759-d43f-4f71-a76f-ba8c60a627fe tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:19.206274 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8ea629a0-8242-4639-9d9d-8816c21029e0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.383906 Aug 31 11:06:19.208078 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 52/113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:18 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:19.214590 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17a0a759-d43f-4f71-a76f-ba8c60a627fe tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:19.216210 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17a0a759-d43f-4f71-a76f-ba8c60a627fe tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:19.218173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17a0a759-d43f-4f71-a76f-ba8c60a627fe tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:19.219007 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17a0a759-d43f-4f71-a76f-ba8c60a627fe tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:19.219888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17a0a759-d43f-4f71-a76f-ba8c60a627fe tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:19.221018 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17a0a759-d43f-4f71-a76f-ba8c60a627fe tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:19.446707 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-68041713-82d3-4890-944e-5a79698d7f0b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:19.449237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-68041713-82d3-4890-944e-5a79698d7f0b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:19.459008 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=74 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:19.460879 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-68041713-82d3-4890-944e-5a79698d7f0b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:19.461597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-68041713-82d3-4890-944e-5a79698d7f0b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:19.462341 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-68041713-82d3-4890-944e-5a79698d7f0b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:19.463263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-68041713-82d3-4890-944e-5a79698d7f0b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:19.463962 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-68041713-82d3-4890-944e-5a79698d7f0b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:19.464621 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-68041713-82d3-4890-944e-5a79698d7f0b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:19.609189 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-17a0a759-d43f-4f71-a76f-ba8c60a627fe tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:19.633672 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-17a0a759-d43f-4f71-a76f-ba8c60a627fe tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1502 microversion: 2.1 time: 0.425984 Aug 31 11:06:19.652068 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 62/114] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:19 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1502 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:19.686688 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-68041713-82d3-4890-944e-5a79698d7f0b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:19.700042 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-68041713-82d3-4890-944e-5a79698d7f0b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1556 microversion: 2.1 time: 0.260832 Aug 31 11:06:19.716114 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 53/115] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:19 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1556 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:19.728768 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9e9bb466-0400-452b-8c1d-3255d98cc2b7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:19.729642 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9e9bb466-0400-452b-8c1d-3255d98cc2b7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:19.743182 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9e9bb466-0400-452b-8c1d-3255d98cc2b7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:19.744054 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9e9bb466-0400-452b-8c1d-3255d98cc2b7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:19.744645 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9e9bb466-0400-452b-8c1d-3255d98cc2b7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:19.745546 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9e9bb466-0400-452b-8c1d-3255d98cc2b7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:19.746187 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9e9bb466-0400-452b-8c1d-3255d98cc2b7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:19.746770 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9e9bb466-0400-452b-8c1d-3255d98cc2b7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:19.863185 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4fa4740a-7bfb-4ed9-a52d-4d2ee061ca45 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:19.863796 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-4fa4740a-7bfb-4ed9-a52d-4d2ee061ca45 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:19.878458 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4fa4740a-7bfb-4ed9-a52d-4d2ee061ca45 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:19.880523 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4fa4740a-7bfb-4ed9-a52d-4d2ee061ca45 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:19.883855 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4fa4740a-7bfb-4ed9-a52d-4d2ee061ca45 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:19.884718 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4fa4740a-7bfb-4ed9-a52d-4d2ee061ca45 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:19.888467 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4fa4740a-7bfb-4ed9-a52d-4d2ee061ca45 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:19.893228 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4fa4740a-7bfb-4ed9-a52d-4d2ee061ca45 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:19.940776 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9e9bb466-0400-452b-8c1d-3255d98cc2b7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.218929 Aug 31 11:06:19.942285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 63/116] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 11:06:19 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:06:20.244215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-61c84299-78be-40bb-a443-c6bf315b126b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:20.245088 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-61c84299-78be-40bb-a443-c6bf315b126b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:20.255330 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-61c84299-78be-40bb-a443-c6bf315b126b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:20.256562 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-61c84299-78be-40bb-a443-c6bf315b126b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:20.257005 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-61c84299-78be-40bb-a443-c6bf315b126b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:20.262529 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-61c84299-78be-40bb-a443-c6bf315b126b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:20.263076 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-61c84299-78be-40bb-a443-c6bf315b126b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:20.264032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-61c84299-78be-40bb-a443-c6bf315b126b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:20.271026 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=100 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:20.345177 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4fa4740a-7bfb-4ed9-a52d-4d2ee061ca45 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:20.360605 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4fa4740a-7bfb-4ed9-a52d-4d2ee061ca45 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:20.367348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4fa4740a-7bfb-4ed9-a52d-4d2ee061ca45 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:20.371653 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4fa4740a-7bfb-4ed9-a52d-4d2ee061ca45 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.514432 Aug 31 11:06:20.403393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 54/117] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:19 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:06:20.894421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-61c84299-78be-40bb-a443-c6bf315b126b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:20.915497 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-61c84299-78be-40bb-a443-c6bf315b126b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1322 microversion: 2.1 time: 0.676401 Aug 31 11:06:20.928323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 64/118] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:20 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1322 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:21.401899 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-399d63fb-f961-4dcd-ac12-c6edf6918e90 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:21.403210 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-399d63fb-f961-4dcd-ac12-c6edf6918e90 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:21.418002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-399d63fb-f961-4dcd-ac12-c6edf6918e90 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:21.420350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-399d63fb-f961-4dcd-ac12-c6edf6918e90 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:21.421817 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-399d63fb-f961-4dcd-ac12-c6edf6918e90 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:21.424762 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-399d63fb-f961-4dcd-ac12-c6edf6918e90 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:21.427240 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-399d63fb-f961-4dcd-ac12-c6edf6918e90 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:21.428745 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-399d63fb-f961-4dcd-ac12-c6edf6918e90 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:21.460055 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c49a0bf5-9222-481f-9754-a7be63d28526 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52e9d067-1681-4990-9425-ce3f3c14cdbd"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:21.462935 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c49a0bf5-9222-481f-9754-a7be63d28526 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:21.470645 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c49a0bf5-9222-481f-9754-a7be63d28526 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:21.471140 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c49a0bf5-9222-481f-9754-a7be63d28526 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:21.471582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c49a0bf5-9222-481f-9754-a7be63d28526 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:21.472463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c49a0bf5-9222-481f-9754-a7be63d28526 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:21.472994 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c49a0bf5-9222-481f-9754-a7be63d28526 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:21.473419 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c49a0bf5-9222-481f-9754-a7be63d28526 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:21.621564 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-399d63fb-f961-4dcd-ac12-c6edf6918e90 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:21.630917 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-399d63fb-f961-4dcd-ac12-c6edf6918e90 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:21.632981 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-399d63fb-f961-4dcd-ac12-c6edf6918e90 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:21.634410 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-399d63fb-f961-4dcd-ac12-c6edf6918e90 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.236411 Aug 31 11:06:21.649446 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 55/119] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:21 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:21.948060 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-389b62ef-76bb-4c58-94d7-7d165e15bb1f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:21.948969 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-389b62ef-76bb-4c58-94d7-7d165e15bb1f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:21.967504 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-389b62ef-76bb-4c58-94d7-7d165e15bb1f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:21.968311 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-389b62ef-76bb-4c58-94d7-7d165e15bb1f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:21.972250 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-389b62ef-76bb-4c58-94d7-7d165e15bb1f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:21.973113 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-389b62ef-76bb-4c58-94d7-7d165e15bb1f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:21.973600 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-389b62ef-76bb-4c58-94d7-7d165e15bb1f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:21.975169 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-389b62ef-76bb-4c58-94d7-7d165e15bb1f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:22.158877 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-389b62ef-76bb-4c58-94d7-7d165e15bb1f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:22.168407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-389b62ef-76bb-4c58-94d7-7d165e15bb1f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1516 microversion: 2.1 time: 0.224969 Aug 31 11:06:22.169254 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 56/120] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:21 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1516 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:22.195365 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-27a6531e-b1ab-477c-8793-a34a027b0275 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:22.197851 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-27a6531e-b1ab-477c-8793-a34a027b0275 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:22.204960 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-27a6531e-b1ab-477c-8793-a34a027b0275 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:22.205389 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-27a6531e-b1ab-477c-8793-a34a027b0275 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:22.205817 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-27a6531e-b1ab-477c-8793-a34a027b0275 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:22.206524 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-27a6531e-b1ab-477c-8793-a34a027b0275 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:22.206972 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-27a6531e-b1ab-477c-8793-a34a027b0275 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:22.207394 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-27a6531e-b1ab-477c-8793-a34a027b0275 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:22.271733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-27a6531e-b1ab-477c-8793-a34a027b0275 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lazy-loading 'flavor' on Instance uuid 5ef326a6-422d-46ab-8437-92751363027e {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:06:22.418780 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-27a6531e-b1ab-477c-8793-a34a027b0275 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "POST /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e/action" status: 200 len: 32 microversion: 2.1 time: 0.226517 Aug 31 11:06:22.425876 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 57/121] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:06:22 2022] POST /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e/action => generated 32 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:06:22.429805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-65f86564-3a84-4e2d-8fd7-20c7809f1acb req-a5e3f6f2-9457-4ede-b500-7b85b9807a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9af9ee9-af17-4f68-bb4a-dcebd9827b12", "tag": "2270adbc-f6f1-4f49-bcf6-15ac3f4a262a"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:22.442190 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-65f86564-3a84-4e2d-8fd7-20c7809f1acb req-a5e3f6f2-9457-4ede-b500-7b85b9807a79 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:22.442667 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-65f86564-3a84-4e2d-8fd7-20c7809f1acb req-a5e3f6f2-9457-4ede-b500-7b85b9807a79 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:22.443079 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-65f86564-3a84-4e2d-8fd7-20c7809f1acb req-a5e3f6f2-9457-4ede-b500-7b85b9807a79 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:22.455763 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-65f86564-3a84-4e2d-8fd7-20c7809f1acb req-a5e3f6f2-9457-4ede-b500-7b85b9807a79 service nova] Creating event network-changed:2270adbc-f6f1-4f49-bcf6-15ac3f4a262a for instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 on hv-cinder-85535 Aug 31 11:06:22.461000 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-65f86564-3a84-4e2d-8fd7-20c7809f1acb req-a5e3f6f2-9457-4ede-b500-7b85b9807a79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036774 Aug 31 11:06:22.461618 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 58/122] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:06:22.467908 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ab79b660-cbc9-4f1b-bd8b-fcb91a191d01 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:22.468694 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ab79b660-cbc9-4f1b-bd8b-fcb91a191d01 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:22.475507 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab79b660-cbc9-4f1b-bd8b-fcb91a191d01 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:22.476317 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab79b660-cbc9-4f1b-bd8b-fcb91a191d01 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:22.476930 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab79b660-cbc9-4f1b-bd8b-fcb91a191d01 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:22.477839 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab79b660-cbc9-4f1b-bd8b-fcb91a191d01 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:22.478289 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab79b660-cbc9-4f1b-bd8b-fcb91a191d01 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:22.478877 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab79b660-cbc9-4f1b-bd8b-fcb91a191d01 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:22.709853 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ab79b660-cbc9-4f1b-bd8b-fcb91a191d01 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:22.721236 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ab79b660-cbc9-4f1b-bd8b-fcb91a191d01 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.258009 Aug 31 11:06:22.722275 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 59/123] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:22 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:22.747070 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-37904fcb-e3fa-4bbb-b8ed-403bd904d68a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:22.748996 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-37904fcb-e3fa-4bbb-b8ed-403bd904d68a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:22.758582 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37904fcb-e3fa-4bbb-b8ed-403bd904d68a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:22.768821 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37904fcb-e3fa-4bbb-b8ed-403bd904d68a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:22.769890 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37904fcb-e3fa-4bbb-b8ed-403bd904d68a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:22.771220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37904fcb-e3fa-4bbb-b8ed-403bd904d68a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:22.772146 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37904fcb-e3fa-4bbb-b8ed-403bd904d68a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:22.772995 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37904fcb-e3fa-4bbb-b8ed-403bd904d68a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:22.779978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:22.984899 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-37904fcb-e3fa-4bbb-b8ed-403bd904d68a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:23.003154 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-37904fcb-e3fa-4bbb-b8ed-403bd904d68a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:23.006482 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-37904fcb-e3fa-4bbb-b8ed-403bd904d68a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:23.008658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-37904fcb-e3fa-4bbb-b8ed-403bd904d68a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.270900 Aug 31 11:06:23.010243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 60/124] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:22 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:23.752074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cc364f67-d7bc-4241-807d-c753950076a2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:23.753041 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-cc364f67-d7bc-4241-807d-c753950076a2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:23.760333 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc364f67-d7bc-4241-807d-c753950076a2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:23.761287 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc364f67-d7bc-4241-807d-c753950076a2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:23.761905 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc364f67-d7bc-4241-807d-c753950076a2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:23.763560 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc364f67-d7bc-4241-807d-c753950076a2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:23.765003 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc364f67-d7bc-4241-807d-c753950076a2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:23.765599 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc364f67-d7bc-4241-807d-c753950076a2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:23.988260 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-cc364f67-d7bc-4241-807d-c753950076a2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:23.997812 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-cc364f67-d7bc-4241-807d-c753950076a2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.251198 Aug 31 11:06:23.998798 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 61/125] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:23 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:24.043518 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c477bbd7-8146-4862-9d99-3b95496e916b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:24.044965 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c477bbd7-8146-4862-9d99-3b95496e916b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:24.061989 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c477bbd7-8146-4862-9d99-3b95496e916b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:24.063462 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c477bbd7-8146-4862-9d99-3b95496e916b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:24.066468 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c477bbd7-8146-4862-9d99-3b95496e916b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:24.068365 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c477bbd7-8146-4862-9d99-3b95496e916b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:24.068963 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c477bbd7-8146-4862-9d99-3b95496e916b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:24.071643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c477bbd7-8146-4862-9d99-3b95496e916b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:24.441704 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c477bbd7-8146-4862-9d99-3b95496e916b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:24.477945 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c477bbd7-8146-4862-9d99-3b95496e916b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:24.482735 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c477bbd7-8146-4862-9d99-3b95496e916b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:24.486089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c477bbd7-8146-4862-9d99-3b95496e916b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1408 microversion: 2.20 time: 0.448638 Aug 31 11:06:24.487024 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 62/126] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:24 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:24.715454 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c49a0bf5-9222-481f-9754-a7be63d28526 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "POST /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.260135 Aug 31 11:06:24.716430 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 65/127] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:06:21 2022] POST /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809/os-volume_attachments => generated 194 bytes in 3262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:06:25.025234 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-fc7ca8f7-2468-4439-86ae-9a047de0f6b6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:25.026045 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-fc7ca8f7-2468-4439-86ae-9a047de0f6b6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:25.033399 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fc7ca8f7-2468-4439-86ae-9a047de0f6b6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:25.034069 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fc7ca8f7-2468-4439-86ae-9a047de0f6b6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:25.034640 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fc7ca8f7-2468-4439-86ae-9a047de0f6b6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:25.035494 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fc7ca8f7-2468-4439-86ae-9a047de0f6b6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:25.036100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fc7ca8f7-2468-4439-86ae-9a047de0f6b6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:25.036692 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fc7ca8f7-2468-4439-86ae-9a047de0f6b6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:25.303193 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-fc7ca8f7-2468-4439-86ae-9a047de0f6b6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:25.333643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-fc7ca8f7-2468-4439-86ae-9a047de0f6b6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.304516 Aug 31 11:06:25.334682 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 63/128] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:25 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:25.522897 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-45d42b68-0934-429f-ae59-26717a8fb69f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:25.523879 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-45d42b68-0934-429f-ae59-26717a8fb69f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:25.553208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45d42b68-0934-429f-ae59-26717a8fb69f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:25.554441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45d42b68-0934-429f-ae59-26717a8fb69f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:25.555145 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45d42b68-0934-429f-ae59-26717a8fb69f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:25.557543 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45d42b68-0934-429f-ae59-26717a8fb69f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:25.562376 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45d42b68-0934-429f-ae59-26717a8fb69f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:25.567651 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45d42b68-0934-429f-ae59-26717a8fb69f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:25.905058 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-45d42b68-0934-429f-ae59-26717a8fb69f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:25.914202 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-45d42b68-0934-429f-ae59-26717a8fb69f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:25.916886 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-45d42b68-0934-429f-ae59-26717a8fb69f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:25.918164 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-45d42b68-0934-429f-ae59-26717a8fb69f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1600 microversion: 2.20 time: 0.404720 Aug 31 11:06:25.919970 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 66/129] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:06:25 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1600 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:06:25.953365 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-09a0361e-b804-4cc1-8a7e-8606ce844f8a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:25.953891 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-09a0361e-b804-4cc1-8a7e-8606ce844f8a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:25.969638 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-09a0361e-b804-4cc1-8a7e-8606ce844f8a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:25.970147 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-09a0361e-b804-4cc1-8a7e-8606ce844f8a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:25.970591 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-09a0361e-b804-4cc1-8a7e-8606ce844f8a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:25.971284 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-09a0361e-b804-4cc1-8a7e-8606ce844f8a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:25.971742 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-09a0361e-b804-4cc1-8a7e-8606ce844f8a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:25.972196 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-09a0361e-b804-4cc1-8a7e-8606ce844f8a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:26.342238 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-09a0361e-b804-4cc1-8a7e-8606ce844f8a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.397859 Aug 31 11:06:26.343378 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 64/130] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Aug 31 11:06:25 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-interface => generated 285 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:06:26.369111 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-07793ec7-a3db-4058-80ef-03380911d02f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:26.377061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-07793ec7-a3db-4058-80ef-03380911d02f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:26.388699 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=83 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:26.390831 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-07793ec7-a3db-4058-80ef-03380911d02f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:26.391345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-07793ec7-a3db-4058-80ef-03380911d02f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:26.392379 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-07793ec7-a3db-4058-80ef-03380911d02f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:26.397337 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-07793ec7-a3db-4058-80ef-03380911d02f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:26.398172 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-07793ec7-a3db-4058-80ef-03380911d02f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:26.399488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-07793ec7-a3db-4058-80ef-03380911d02f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:26.755260 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-07793ec7-a3db-4058-80ef-03380911d02f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:26.814965 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-07793ec7-a3db-4058-80ef-03380911d02f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.450167 Aug 31 11:06:26.817859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 67/131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:26 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:27.668628 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-06865d6f-5e09-41f1-b5a3-7cf555937a28 req-e1d900c3-94d0-4ee2-a22b-8a6d97090372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e", "tag": "a2414d6d-8b79-405f-a378-ffbb986542cb"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:27.680413 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-06865d6f-5e09-41f1-b5a3-7cf555937a28 req-e1d900c3-94d0-4ee2-a22b-8a6d97090372 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:27.680886 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-06865d6f-5e09-41f1-b5a3-7cf555937a28 req-e1d900c3-94d0-4ee2-a22b-8a6d97090372 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:27.681305 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-06865d6f-5e09-41f1-b5a3-7cf555937a28 req-e1d900c3-94d0-4ee2-a22b-8a6d97090372 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:27.696635 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-06865d6f-5e09-41f1-b5a3-7cf555937a28 req-e1d900c3-94d0-4ee2-a22b-8a6d97090372 service nova] Creating event network-changed:a2414d6d-8b79-405f-a378-ffbb986542cb for instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e on hv-cinder-85535 Aug 31 11:06:27.701588 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-06865d6f-5e09-41f1-b5a3-7cf555937a28 req-e1d900c3-94d0-4ee2-a22b-8a6d97090372 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037275 Aug 31 11:06:27.703237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 65/132] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:06:27.838076 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4b0f3938-001f-42f2-9392-7cb844d98817 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:27.838925 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4b0f3938-001f-42f2-9392-7cb844d98817 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:27.852877 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-161105839", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "networks": [{"uuid": "ede39734-7054-4d40-88a0-7e74e8650ae1"}]}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:27.866173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4b0f3938-001f-42f2-9392-7cb844d98817 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:27.866656 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4b0f3938-001f-42f2-9392-7cb844d98817 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:27.867084 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4b0f3938-001f-42f2-9392-7cb844d98817 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:27.867942 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4b0f3938-001f-42f2-9392-7cb844d98817 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:27.870053 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4b0f3938-001f-42f2-9392-7cb844d98817 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:27.874051 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4b0f3938-001f-42f2-9392-7cb844d98817 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:27.962829 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.network.neutron [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] validate_networks() for [('ede39734-7054-4d40-88a0-7e74e8650ae1', None, None, None, None, None)] {{(pid=120655) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:06:28.210140 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4b0f3938-001f-42f2-9392-7cb844d98817 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:28.251516 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4b0f3938-001f-42f2-9392-7cb844d98817 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.413243 Aug 31 11:06:28.253045 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 68/133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:27 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:28.769525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Flavor limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:06:28.770402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Image limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:06:28.770402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Flavor pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:06:28.770944 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Image pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:06:28.771615 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:06:28.783318 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:28.785372 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:28.786218 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:28.787724 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:28.788664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:28.790091 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:28.817822 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Getting quotas for project b2365f1500c5405aab2ea6e892fbb832. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:06:28.823355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Getting quotas for user fe027aad062342688c587428f2bfbfe7 and project b2365f1500c5405aab2ea6e892fbb832. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:06:28.839654 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Going to run 1 instances... {{(pid=120655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:06:28.842917 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:06:28.896669 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-9f5fef52-0c83-456c-b97e-0e64819ad1d7 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048532 Aug 31 11:06:28.897675 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 66/134] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:06:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:06:28.915341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-340d7211-dea8-445a-aaf1-dcceb9a01ca1 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:28.916720 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-340d7211-dea8-445a-aaf1-dcceb9a01ca1 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:29.001119 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-340d7211-dea8-445a-aaf1-dcceb9a01ca1 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:29.009815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-340d7211-dea8-445a-aaf1-dcceb9a01ca1 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1213 microversion: 2.1 time: 0.099188 Aug 31 11:06:29.010587 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 69/135] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:28 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:29.277527 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cc2546fb-c90f-42e1-af15-4a55c2b3eaf7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:29.279383 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-cc2546fb-c90f-42e1-af15-4a55c2b3eaf7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:29.286725 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc2546fb-c90f-42e1-af15-4a55c2b3eaf7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:29.287586 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc2546fb-c90f-42e1-af15-4a55c2b3eaf7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:29.288304 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc2546fb-c90f-42e1-af15-4a55c2b3eaf7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:29.289351 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc2546fb-c90f-42e1-af15-4a55c2b3eaf7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:29.290114 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc2546fb-c90f-42e1-af15-4a55c2b3eaf7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:29.290714 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc2546fb-c90f-42e1-af15-4a55c2b3eaf7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:29.478168 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-cc2546fb-c90f-42e1-af15-4a55c2b3eaf7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:29.492634 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-cc2546fb-c90f-42e1-af15-4a55c2b3eaf7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.218629 Aug 31 11:06:29.493788 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 67/136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:29 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:30.034100 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4c9cfd73-69f9-4a9b-901f-63664fab589c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:30.035707 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4c9cfd73-69f9-4a9b-901f-63664fab589c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:30.046459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c9cfd73-69f9-4a9b-901f-63664fab589c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:30.047360 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c9cfd73-69f9-4a9b-901f-63664fab589c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:30.047982 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c9cfd73-69f9-4a9b-901f-63664fab589c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:30.049023 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c9cfd73-69f9-4a9b-901f-63664fab589c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:30.049641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c9cfd73-69f9-4a9b-901f-63664fab589c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:30.050204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c9cfd73-69f9-4a9b-901f-63664fab589c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:30.139574 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4c9cfd73-69f9-4a9b-901f-63664fab589c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:30.149095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4c9cfd73-69f9-4a9b-901f-63664fab589c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1265 microversion: 2.1 time: 0.120049 Aug 31 11:06:30.150433 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 70/137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:30 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:30.515915 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ab31c7a8-9484-484d-a57c-d41662c28a2f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:30.517384 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ab31c7a8-9484-484d-a57c-d41662c28a2f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:30.534533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab31c7a8-9484-484d-a57c-d41662c28a2f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:30.535033 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab31c7a8-9484-484d-a57c-d41662c28a2f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:30.535475 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab31c7a8-9484-484d-a57c-d41662c28a2f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:30.536222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab31c7a8-9484-484d-a57c-d41662c28a2f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:30.536676 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab31c7a8-9484-484d-a57c-d41662c28a2f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:30.537101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab31c7a8-9484-484d-a57c-d41662c28a2f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:30.892317 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ab31c7a8-9484-484d-a57c-d41662c28a2f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:30.904626 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ab31c7a8-9484-484d-a57c-d41662c28a2f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.392772 Aug 31 11:06:30.920480 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 68/138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:30 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:31.173896 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d5cfdc4c-83d3-49aa-8f38-8c3d4013122d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:31.175951 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d5cfdc4c-83d3-49aa-8f38-8c3d4013122d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:31.190737 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d5cfdc4c-83d3-49aa-8f38-8c3d4013122d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:31.191920 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d5cfdc4c-83d3-49aa-8f38-8c3d4013122d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:31.192671 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d5cfdc4c-83d3-49aa-8f38-8c3d4013122d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:31.193688 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d5cfdc4c-83d3-49aa-8f38-8c3d4013122d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:31.194596 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d5cfdc4c-83d3-49aa-8f38-8c3d4013122d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:31.201265 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d5cfdc4c-83d3-49aa-8f38-8c3d4013122d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:31.352859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d5cfdc4c-83d3-49aa-8f38-8c3d4013122d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:31.362680 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d5cfdc4c-83d3-49aa-8f38-8c3d4013122d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1271 microversion: 2.1 time: 0.195595 Aug 31 11:06:31.364047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 71/139] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:31 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:31.934942 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3ae5b859-8fbc-4cfc-99ef-618b1e261ba3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:31.935901 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3ae5b859-8fbc-4cfc-99ef-618b1e261ba3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:31.944653 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ae5b859-8fbc-4cfc-99ef-618b1e261ba3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:31.945255 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ae5b859-8fbc-4cfc-99ef-618b1e261ba3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:31.946012 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ae5b859-8fbc-4cfc-99ef-618b1e261ba3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:31.947004 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ae5b859-8fbc-4cfc-99ef-618b1e261ba3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:31.947956 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ae5b859-8fbc-4cfc-99ef-618b1e261ba3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:31.948858 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ae5b859-8fbc-4cfc-99ef-618b1e261ba3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:32.296546 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3ae5b859-8fbc-4cfc-99ef-618b1e261ba3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:32.308284 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3ae5b859-8fbc-4cfc-99ef-618b1e261ba3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.380836 Aug 31 11:06:32.324070 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 69/140] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:31 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:32.389982 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d6de20ad-4a4d-46f0-a341-c50c05ad1538 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:32.390591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d6de20ad-4a4d-46f0-a341-c50c05ad1538 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:32.421784 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6de20ad-4a4d-46f0-a341-c50c05ad1538 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:32.422291 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6de20ad-4a4d-46f0-a341-c50c05ad1538 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:32.422737 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6de20ad-4a4d-46f0-a341-c50c05ad1538 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:32.423798 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6de20ad-4a4d-46f0-a341-c50c05ad1538 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:32.425261 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6de20ad-4a4d-46f0-a341-c50c05ad1538 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:32.425733 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6de20ad-4a4d-46f0-a341-c50c05ad1538 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:32.819051 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d6de20ad-4a4d-46f0-a341-c50c05ad1538 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:32.837693 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d6de20ad-4a4d-46f0-a341-c50c05ad1538 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1313 microversion: 2.1 time: 0.453736 Aug 31 11:06:32.853427 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 72/141] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:32 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:33.012979 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-7308a674-36e6-479e-a4a9-827a3686d76a req-bc438106-17ce-48d5-8633-5355d180938a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bd184d-2701-4cb1-b758-b234dcd861a1", "tag": "04b519bc-23c9-4935-a87b-13b2c0931560"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:33.032873 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-7308a674-36e6-479e-a4a9-827a3686d76a req-bc438106-17ce-48d5-8633-5355d180938a service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:33.033641 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-7308a674-36e6-479e-a4a9-827a3686d76a req-bc438106-17ce-48d5-8633-5355d180938a service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:33.034414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-7308a674-36e6-479e-a4a9-827a3686d76a req-bc438106-17ce-48d5-8633-5355d180938a service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:33.064556 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-7308a674-36e6-479e-a4a9-827a3686d76a req-bc438106-17ce-48d5-8633-5355d180938a service nova] Creating event network-changed:04b519bc-23c9-4935-a87b-13b2c0931560 for instance 42bd184d-2701-4cb1-b758-b234dcd861a1 on hv-cinder-85535 Aug 31 11:06:33.076731 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-7308a674-36e6-479e-a4a9-827a3686d76a req-bc438106-17ce-48d5-8633-5355d180938a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070740 Aug 31 11:06:33.079312 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 70/142] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:06:33.337748 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3a46a8cb-dde3-41a3-80ac-c9da5f8c8b45 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:33.341356 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3a46a8cb-dde3-41a3-80ac-c9da5f8c8b45 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:33.383149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3a46a8cb-dde3-41a3-80ac-c9da5f8c8b45 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:33.393410 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3a46a8cb-dde3-41a3-80ac-c9da5f8c8b45 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:33.393992 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3a46a8cb-dde3-41a3-80ac-c9da5f8c8b45 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:33.394610 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3a46a8cb-dde3-41a3-80ac-c9da5f8c8b45 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:33.397408 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3a46a8cb-dde3-41a3-80ac-c9da5f8c8b45 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:33.397868 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3a46a8cb-dde3-41a3-80ac-c9da5f8c8b45 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:33.594853 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3a46a8cb-dde3-41a3-80ac-c9da5f8c8b45 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:33.607232 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3a46a8cb-dde3-41a3-80ac-c9da5f8c8b45 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.277869 Aug 31 11:06:33.608799 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 73/143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:33 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:33.883113 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-57bf9d21-717b-4d62-a32d-dce8c2a21a60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:33.889810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-57bf9d21-717b-4d62-a32d-dce8c2a21a60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:33.911780 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57bf9d21-717b-4d62-a32d-dce8c2a21a60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:33.913210 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57bf9d21-717b-4d62-a32d-dce8c2a21a60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:33.914374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57bf9d21-717b-4d62-a32d-dce8c2a21a60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:33.916854 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57bf9d21-717b-4d62-a32d-dce8c2a21a60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:33.917731 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57bf9d21-717b-4d62-a32d-dce8c2a21a60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:33.919109 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57bf9d21-717b-4d62-a32d-dce8c2a21a60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:34.267486 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-57bf9d21-717b-4d62-a32d-dce8c2a21a60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:34.281815 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-57bf9d21-717b-4d62-a32d-dce8c2a21a60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1313 microversion: 2.1 time: 0.412193 Aug 31 11:06:34.282663 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 71/144] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:33 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:34.640554 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6a4c97ba-07b7-4d16-893f-e51b9f759063 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:34.641171 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6a4c97ba-07b7-4d16-893f-e51b9f759063 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:34.676037 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a4c97ba-07b7-4d16-893f-e51b9f759063 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:34.676561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a4c97ba-07b7-4d16-893f-e51b9f759063 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:34.676990 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a4c97ba-07b7-4d16-893f-e51b9f759063 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:34.677702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a4c97ba-07b7-4d16-893f-e51b9f759063 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:34.678205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a4c97ba-07b7-4d16-893f-e51b9f759063 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:34.678545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a4c97ba-07b7-4d16-893f-e51b9f759063 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:34.984378 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6a4c97ba-07b7-4d16-893f-e51b9f759063 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:35.000936 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6a4c97ba-07b7-4d16-893f-e51b9f759063 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.364477 Aug 31 11:06:35.003201 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 74/145] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:34 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:35.311170 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3d893a2a-e2db-42f4-899c-b15a008d2eee tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:35.314964 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3d893a2a-e2db-42f4-899c-b15a008d2eee tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:35.326186 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3d893a2a-e2db-42f4-899c-b15a008d2eee tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:35.338673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3d893a2a-e2db-42f4-899c-b15a008d2eee tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:35.339989 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3d893a2a-e2db-42f4-899c-b15a008d2eee tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:35.342649 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3d893a2a-e2db-42f4-899c-b15a008d2eee tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:35.343772 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3d893a2a-e2db-42f4-899c-b15a008d2eee tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:35.345045 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3d893a2a-e2db-42f4-899c-b15a008d2eee tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:35.398332 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-41c0a86e-eaa0-4abb-871d-26819e4ff300 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:35.399923 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-41c0a86e-eaa0-4abb-871d-26819e4ff300 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:35.414421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-41c0a86e-eaa0-4abb-871d-26819e4ff300 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:35.418103 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-41c0a86e-eaa0-4abb-871d-26819e4ff300 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:35.419917 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-41c0a86e-eaa0-4abb-871d-26819e4ff300 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:35.421132 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-41c0a86e-eaa0-4abb-871d-26819e4ff300 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:35.422399 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-41c0a86e-eaa0-4abb-871d-26819e4ff300 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:35.422983 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-41c0a86e-eaa0-4abb-871d-26819e4ff300 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:35.497241 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-41c0a86e-eaa0-4abb-871d-26819e4ff300 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:06:35.668387 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-41c0a86e-eaa0-4abb-871d-26819e4ff300 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "DELETE /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 204 len: 0 microversion: 2.1 time: 0.278886 Aug 31 11:06:35.668387 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 75/146] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:06:35 2022] DELETE /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:06:35.680170 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-dc027c45-66dc-4b23-9100-496542897629 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:35.681868 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-dc027c45-66dc-4b23-9100-496542897629 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:35.689784 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc027c45-66dc-4b23-9100-496542897629 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:35.690503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc027c45-66dc-4b23-9100-496542897629 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:35.691145 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc027c45-66dc-4b23-9100-496542897629 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:35.692813 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc027c45-66dc-4b23-9100-496542897629 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:35.694831 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc027c45-66dc-4b23-9100-496542897629 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:35.695678 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc027c45-66dc-4b23-9100-496542897629 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:35.942887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-dc027c45-66dc-4b23-9100-496542897629 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:35.975290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-dc027c45-66dc-4b23-9100-496542897629 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1554 microversion: 2.1 time: 0.300022 Aug 31 11:06:35.977111 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 76/147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:35 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1554 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:36.038392 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4378e76d-9645-460c-b29f-ea56277c2d11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:36.039900 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4378e76d-9645-460c-b29f-ea56277c2d11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:36.051746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4378e76d-9645-460c-b29f-ea56277c2d11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:36.055543 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4378e76d-9645-460c-b29f-ea56277c2d11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:36.058629 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4378e76d-9645-460c-b29f-ea56277c2d11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:36.073693 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4378e76d-9645-460c-b29f-ea56277c2d11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:36.077213 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4378e76d-9645-460c-b29f-ea56277c2d11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:36.078386 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4378e76d-9645-460c-b29f-ea56277c2d11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:36.099944 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3d893a2a-e2db-42f4-899c-b15a008d2eee tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:36.121396 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3d893a2a-e2db-42f4-899c-b15a008d2eee tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1313 microversion: 2.1 time: 0.817756 Aug 31 11:06:36.128136 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 72/148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:35 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1313 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:36.351514 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4378e76d-9645-460c-b29f-ea56277c2d11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:36.363245 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4378e76d-9645-460c-b29f-ea56277c2d11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.340678 Aug 31 11:06:36.376666 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 77/149] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:36 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:37.006609 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9c7b0e04-1992-4796-adb2-911033fa5ea2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:37.007816 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-9c7b0e04-1992-4796-adb2-911033fa5ea2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:37.019867 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c7b0e04-1992-4796-adb2-911033fa5ea2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:37.020656 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c7b0e04-1992-4796-adb2-911033fa5ea2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:37.024896 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c7b0e04-1992-4796-adb2-911033fa5ea2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:37.032398 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c7b0e04-1992-4796-adb2-911033fa5ea2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:37.033105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c7b0e04-1992-4796-adb2-911033fa5ea2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:37.033508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c7b0e04-1992-4796-adb2-911033fa5ea2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:37.154188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fac96a8b-b3b5-438a-be27-c05328c1c42b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:37.154964 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fac96a8b-b3b5-438a-be27-c05328c1c42b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:37.183456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fac96a8b-b3b5-438a-be27-c05328c1c42b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:37.186725 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fac96a8b-b3b5-438a-be27-c05328c1c42b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:37.186725 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fac96a8b-b3b5-438a-be27-c05328c1c42b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:37.187568 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fac96a8b-b3b5-438a-be27-c05328c1c42b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:37.188711 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fac96a8b-b3b5-438a-be27-c05328c1c42b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:37.189723 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fac96a8b-b3b5-438a-be27-c05328c1c42b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:37.343399 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-9c7b0e04-1992-4796-adb2-911033fa5ea2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:37.371023 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-9c7b0e04-1992-4796-adb2-911033fa5ea2 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1554 microversion: 2.1 time: 0.366975 Aug 31 11:06:37.381092 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 73/150] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:37 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1554 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:37.391111 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0f135095-0988-4480-bb03-f319d47bde8a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:37.392344 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0f135095-0988-4480-bb03-f319d47bde8a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:37.426902 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f135095-0988-4480-bb03-f319d47bde8a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:37.427636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f135095-0988-4480-bb03-f319d47bde8a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:37.428656 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f135095-0988-4480-bb03-f319d47bde8a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:37.435609 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f135095-0988-4480-bb03-f319d47bde8a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:37.436826 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f135095-0988-4480-bb03-f319d47bde8a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:37.437836 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f135095-0988-4480-bb03-f319d47bde8a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:37.485219 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fac96a8b-b3b5-438a-be27-c05328c1c42b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:37.490387 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:37.512806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fac96a8b-b3b5-438a-be27-c05328c1c42b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1313 microversion: 2.1 time: 0.365435 Aug 31 11:06:37.513732 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 78/151] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:37 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:37.816328 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0f135095-0988-4480-bb03-f319d47bde8a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:37.825633 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0f135095-0988-4480-bb03-f319d47bde8a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.442599 Aug 31 11:06:37.827152 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 74/152] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:37 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:38.400673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e2b66b0c-3723-4897-8f29-73b97604e6b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:38.409510 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e2b66b0c-3723-4897-8f29-73b97604e6b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:38.430432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e2b66b0c-3723-4897-8f29-73b97604e6b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:38.431609 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e2b66b0c-3723-4897-8f29-73b97604e6b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:38.433547 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e2b66b0c-3723-4897-8f29-73b97604e6b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:38.434539 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e2b66b0c-3723-4897-8f29-73b97604e6b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:38.435172 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e2b66b0c-3723-4897-8f29-73b97604e6b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:38.435765 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e2b66b0c-3723-4897-8f29-73b97604e6b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:38.547694 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ae9e0f03-1b43-4837-b091-ba494120316b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:38.548721 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ae9e0f03-1b43-4837-b091-ba494120316b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:38.559871 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ae9e0f03-1b43-4837-b091-ba494120316b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:38.560551 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ae9e0f03-1b43-4837-b091-ba494120316b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:38.563849 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ae9e0f03-1b43-4837-b091-ba494120316b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:38.565063 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ae9e0f03-1b43-4837-b091-ba494120316b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:38.565752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ae9e0f03-1b43-4837-b091-ba494120316b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:38.566589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ae9e0f03-1b43-4837-b091-ba494120316b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:38.613640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e2b66b0c-3723-4897-8f29-73b97604e6b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:38.626474 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e2b66b0c-3723-4897-8f29-73b97604e6b6 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1554 microversion: 2.1 time: 0.234584 Aug 31 11:06:38.627114 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 79/153] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:38 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:38.803607 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:38.833721 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ae9e0f03-1b43-4837-b091-ba494120316b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:38.844096 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=6 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:38.848367 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-62a4fc1c-92cd-445b-9142-fcf7bba8d4df tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:38.849065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-62a4fc1c-92cd-445b-9142-fcf7bba8d4df tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:38.860681 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ae9e0f03-1b43-4837-b091-ba494120316b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1313 microversion: 2.1 time: 0.322312 Aug 31 11:06:38.861281 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-62a4fc1c-92cd-445b-9142-fcf7bba8d4df tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:38.861887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-62a4fc1c-92cd-445b-9142-fcf7bba8d4df tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:38.863324 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 75/154] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:38 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:38.866696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-62a4fc1c-92cd-445b-9142-fcf7bba8d4df tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:38.867587 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-62a4fc1c-92cd-445b-9142-fcf7bba8d4df tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:38.868107 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-62a4fc1c-92cd-445b-9142-fcf7bba8d4df tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:38.868508 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-62a4fc1c-92cd-445b-9142-fcf7bba8d4df tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:39.006359 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:39.094070 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-62a4fc1c-92cd-445b-9142-fcf7bba8d4df tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:39.111682 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-62a4fc1c-92cd-445b-9142-fcf7bba8d4df tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.267348 Aug 31 11:06:39.119042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 80/155] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:38 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:39.676633 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1a4edeb0-f4ae-4d30-a194-241ba0565822 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:39.680661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-1a4edeb0-f4ae-4d30-a194-241ba0565822 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:39.710088 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1a4edeb0-f4ae-4d30-a194-241ba0565822 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:39.710857 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1a4edeb0-f4ae-4d30-a194-241ba0565822 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:39.711465 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1a4edeb0-f4ae-4d30-a194-241ba0565822 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:39.718246 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1a4edeb0-f4ae-4d30-a194-241ba0565822 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:39.719496 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1a4edeb0-f4ae-4d30-a194-241ba0565822 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:39.720846 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1a4edeb0-f4ae-4d30-a194-241ba0565822 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:39.882872 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-775dd446-e8cb-4586-a5e0-b496fdf2ea3f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:39.883422 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-775dd446-e8cb-4586-a5e0-b496fdf2ea3f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:39.891589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-775dd446-e8cb-4586-a5e0-b496fdf2ea3f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:39.893149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-775dd446-e8cb-4586-a5e0-b496fdf2ea3f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:39.893817 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-775dd446-e8cb-4586-a5e0-b496fdf2ea3f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:39.898880 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-775dd446-e8cb-4586-a5e0-b496fdf2ea3f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:39.899657 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-775dd446-e8cb-4586-a5e0-b496fdf2ea3f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:39.899863 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-775dd446-e8cb-4586-a5e0-b496fdf2ea3f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:40.151522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-775dd446-e8cb-4586-a5e0-b496fdf2ea3f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:40.170622 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-775dd446-e8cb-4586-a5e0-b496fdf2ea3f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1313 microversion: 2.1 time: 0.291242 Aug 31 11:06:40.171760 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 81/156] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:39 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:40.190459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a17ecc3b-c9b0-4791-9ae4-c9d538fc9010 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:40.192163 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a17ecc3b-c9b0-4791-9ae4-c9d538fc9010 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:40.203829 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a17ecc3b-c9b0-4791-9ae4-c9d538fc9010 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:40.204565 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a17ecc3b-c9b0-4791-9ae4-c9d538fc9010 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:40.205008 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a17ecc3b-c9b0-4791-9ae4-c9d538fc9010 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:40.205728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a17ecc3b-c9b0-4791-9ae4-c9d538fc9010 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:40.206445 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a17ecc3b-c9b0-4791-9ae4-c9d538fc9010 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:40.206868 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a17ecc3b-c9b0-4791-9ae4-c9d538fc9010 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:40.342459 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-1a4edeb0-f4ae-4d30-a194-241ba0565822 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:40.354829 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-1a4edeb0-f4ae-4d30-a194-241ba0565822 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1554 microversion: 2.1 time: 0.694865 Aug 31 11:06:40.368767 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 76/157] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:39 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1554 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:40.417320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a17ecc3b-c9b0-4791-9ae4-c9d538fc9010 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:40.432814 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a17ecc3b-c9b0-4791-9ae4-c9d538fc9010 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.258985 Aug 31 11:06:40.434564 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 82/158] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:40 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:40.953212 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-0479500c-e068-4e21-9037-ce868d9f85cb req-aaab7c82-dad4-48fd-b9b5-2202c4dbaa80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a53db1-1075-4ae2-a541-fdf0936c6809", "name": "network-vif-deleted", "tag": "bb6a3c4e-f4e5-4304-9b95-f2f8786d83ac"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:40.989130 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-0479500c-e068-4e21-9037-ce868d9f85cb req-aaab7c82-dad4-48fd-b9b5-2202c4dbaa80 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:40.990023 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-0479500c-e068-4e21-9037-ce868d9f85cb req-aaab7c82-dad4-48fd-b9b5-2202c4dbaa80 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:40.991153 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-0479500c-e068-4e21-9037-ce868d9f85cb req-aaab7c82-dad4-48fd-b9b5-2202c4dbaa80 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:41.042038 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-0479500c-e068-4e21-9037-ce868d9f85cb req-aaab7c82-dad4-48fd-b9b5-2202c4dbaa80 service nova] Creating event network-vif-deleted:bb6a3c4e-f4e5-4304-9b95-f2f8786d83ac for instance 50a53db1-1075-4ae2-a541-fdf0936c6809 on hv-cinder-85535 Aug 31 11:06:41.050787 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-0479500c-e068-4e21-9037-ce868d9f85cb req-aaab7c82-dad4-48fd-b9b5-2202c4dbaa80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103585 Aug 31 11:06:41.052205 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 77/159] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:06:41.202715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-63dcbd7c-0156-49e1-b489-94e2ff48560a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:41.205082 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-63dcbd7c-0156-49e1-b489-94e2ff48560a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:41.217227 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63dcbd7c-0156-49e1-b489-94e2ff48560a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:41.222582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63dcbd7c-0156-49e1-b489-94e2ff48560a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:41.223304 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63dcbd7c-0156-49e1-b489-94e2ff48560a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:41.224258 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63dcbd7c-0156-49e1-b489-94e2ff48560a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:41.229798 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63dcbd7c-0156-49e1-b489-94e2ff48560a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:41.230614 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63dcbd7c-0156-49e1-b489-94e2ff48560a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:41.394043 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-58050c50-1cae-477c-9f31-954c205e70f7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:41.403448 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-58050c50-1cae-477c-9f31-954c205e70f7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:41.463022 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-58050c50-1cae-477c-9f31-954c205e70f7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:41.463991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-58050c50-1cae-477c-9f31-954c205e70f7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:41.475370 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-58050c50-1cae-477c-9f31-954c205e70f7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:41.477138 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-58050c50-1cae-477c-9f31-954c205e70f7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:41.477652 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-58050c50-1cae-477c-9f31-954c205e70f7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:41.480283 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-58050c50-1cae-477c-9f31-954c205e70f7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:41.678316 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-58050c50-1cae-477c-9f31-954c205e70f7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0517d50b405e4bce991bb22eef6076a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee7c5a0b37b4192a3746ee760ecefa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:41.714208 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-58050c50-1cae-477c-9f31-954c205e70f7 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 200 len: 1346 microversion: 2.1 time: 0.336174 Aug 31 11:06:41.717542 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 78/160] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:41 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 1346 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:41.737979 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-63dcbd7c-0156-49e1-b489-94e2ff48560a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:41.751135 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-63dcbd7c-0156-49e1-b489-94e2ff48560a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1313 microversion: 2.1 time: 0.558925 Aug 31 11:06:41.753473 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 83/161] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:41 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:41.756097 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-2807acca-73df-475d-acfc-b13c2a7ee673 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:41.756862 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-2807acca-73df-475d-acfc-b13c2a7ee673 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:41.783099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2807acca-73df-475d-acfc-b13c2a7ee673 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:41.785796 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2807acca-73df-475d-acfc-b13c2a7ee673 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:41.794413 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2807acca-73df-475d-acfc-b13c2a7ee673 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:41.797471 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2807acca-73df-475d-acfc-b13c2a7ee673 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:41.798379 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2807acca-73df-475d-acfc-b13c2a7ee673 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:41.799064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2807acca-73df-475d-acfc-b13c2a7ee673 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:42.157691 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-2807acca-73df-475d-acfc-b13c2a7ee673 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:42.161845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=100 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:42.178320 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-2807acca-73df-475d-acfc-b13c2a7ee673 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.459033 Aug 31 11:06:42.179411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 79/162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:41 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:42.744636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2d608412-c48a-4914-8894-e7d99def8edc tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:42.745542 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2d608412-c48a-4914-8894-e7d99def8edc tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:42.790304 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c2256a1f-504f-4c98-a8fe-3bbe8111905c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:42.791312 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c2256a1f-504f-4c98-a8fe-3bbe8111905c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:42.796629 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2d608412-c48a-4914-8894-e7d99def8edc tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:42.797702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2d608412-c48a-4914-8894-e7d99def8edc tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:42.801063 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2d608412-c48a-4914-8894-e7d99def8edc tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:42.802430 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2d608412-c48a-4914-8894-e7d99def8edc tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:42.803311 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2d608412-c48a-4914-8894-e7d99def8edc tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:42.803946 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2d608412-c48a-4914-8894-e7d99def8edc tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:42.809667 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c2256a1f-504f-4c98-a8fe-3bbe8111905c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:42.810173 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c2256a1f-504f-4c98-a8fe-3bbe8111905c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:42.812897 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c2256a1f-504f-4c98-a8fe-3bbe8111905c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:42.815134 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c2256a1f-504f-4c98-a8fe-3bbe8111905c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:42.816630 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c2256a1f-504f-4c98-a8fe-3bbe8111905c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:42.818189 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c2256a1f-504f-4c98-a8fe-3bbe8111905c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:42.834176 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-2d608412-c48a-4914-8894-e7d99def8edc tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] HTTP exception thrown: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2d608412-c48a-4914-8894-e7d99def8edc tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Request method failure captured: Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 HTTP/1.1 Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0B4PaU_6OwZ8INCTo_nUDPvaBXNRzlqt2nTqWpLe6LtuOwgbri3HDwIbmG6rVv7vTVwd0E7EXUQ-bOogFz-wfsNYMdoYbK6AIp3iPCj9X-3ZnkIpJqBzUb_R9lPGdLdQCauTKZ3XJvI3-0uIo9QZgpfoDqHDISnrTzntzvpRIAAH2o Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 0ee7c5a0b37b4192a3746ee760ecefa5 Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-DeleteServersTestJSON-1234472477 Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:06:42.846383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:06:42.850236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0ee7c5a0b37b4192a3746ee760ecefa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0ee7c5a0b37b4192a3746ee760ecefa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ee7c5a0b37b4192a3746ee760ecefa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ee7c5a0b37b4192a3746ee760ecefa5"}]}] Aug 31 11:06:42.850236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-DeleteServersTestJSON-1234472477 Aug 31 11:06:42.850236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 0ee7c5a0b37b4192a3746ee760ecefa5 Aug 31 11:06:42.850236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-DeleteServersTestJSON-1234472477 Aug 31 11:06:42.850236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-DeleteServersTestJSON-1234472477-project Aug 31 11:06:42.850236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:06:42.850236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:06:42.850236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 0517d50b405e4bce991bb22eef6076a4 Aug 31 11:06:42.850236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-DeleteServersTestJSON-1234472477-project Aug 31 11:06:42.850236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:06:42.850236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:42.850236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '50a53db1-1075-4ae2-a541-fdf0936c6809'} Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:06:42.851214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:42.852650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:42.859785 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2d608412-c48a-4914-8894-e7d99def8edc tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Returning 404 to user: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:06:42.863289 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2d608412-c48a-4914-8894-e7d99def8edc tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 404 len: 111 microversion: 2.1 time: 0.123382 Aug 31 11:06:42.865854 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 84/163] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:42 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:06:43.076522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e8fa9506-53c5-4c52-adbd-ac3b20ace8c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:43.076522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e8fa9506-53c5-4c52-adbd-ac3b20ace8c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:43.093898 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e8fa9506-53c5-4c52-adbd-ac3b20ace8c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:43.094530 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e8fa9506-53c5-4c52-adbd-ac3b20ace8c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:43.095023 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e8fa9506-53c5-4c52-adbd-ac3b20ace8c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:43.096426 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e8fa9506-53c5-4c52-adbd-ac3b20ace8c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:43.097129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e8fa9506-53c5-4c52-adbd-ac3b20ace8c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:43.097575 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e8fa9506-53c5-4c52-adbd-ac3b20ace8c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:43.141943 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-e8fa9506-53c5-4c52-adbd-ac3b20ace8c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] HTTP exception thrown: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e8fa9506-53c5-4c52-adbd-ac3b20ace8c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Request method failure captured: Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809/os-volume_attachments HTTP/1.1 Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0B4PaU_6OwZ8INCTo_nUDPvaBXNRzlqt2nTqWpLe6LtuOwgbri3HDwIbmG6rVv7vTVwd0E7EXUQ-bOogFz-wfsNYMdoYbK6AIp3iPCj9X-3ZnkIpJqBzUb_R9lPGdLdQCauTKZ3XJvI3-0uIo9QZgpfoDqHDISnrTzntzvpRIAAH2o Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 0ee7c5a0b37b4192a3746ee760ecefa5 Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-DeleteServersTestJSON-1234472477 Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:06:43.144290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:06:43.152108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0ee7c5a0b37b4192a3746ee760ecefa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0ee7c5a0b37b4192a3746ee760ecefa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ee7c5a0b37b4192a3746ee760ecefa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ee7c5a0b37b4192a3746ee760ecefa5"}]}] Aug 31 11:06:43.152108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-DeleteServersTestJSON-1234472477 Aug 31 11:06:43.152108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 0ee7c5a0b37b4192a3746ee760ecefa5 Aug 31 11:06:43.152108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-DeleteServersTestJSON-1234472477 Aug 31 11:06:43.152108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-DeleteServersTestJSON-1234472477-project Aug 31 11:06:43.152108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:06:43.152108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:06:43.152108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 0517d50b405e4bce991bb22eef6076a4 Aug 31 11:06:43.152108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-DeleteServersTestJSON-1234472477-project Aug 31 11:06:43.152108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:06:43.152108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:43.152108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'server_id': '50a53db1-1075-4ae2-a541-fdf0936c6809'} Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:06:43.155432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:43.163822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:43.172179 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e8fa9506-53c5-4c52-adbd-ac3b20ace8c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Returning 404 to user: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:06:43.172179 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e8fa9506-53c5-4c52-adbd-ac3b20ace8c9 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.089293 Aug 31 11:06:43.172179 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 85/164] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:06:43 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809/os-volume_attachments => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:06:43.198999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f862bfb2-1719-4318-baa2-a46fad0f7bf8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:43.201088 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f862bfb2-1719-4318-baa2-a46fad0f7bf8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:43.213801 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f862bfb2-1719-4318-baa2-a46fad0f7bf8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:43.214293 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f862bfb2-1719-4318-baa2-a46fad0f7bf8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:43.214738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f862bfb2-1719-4318-baa2-a46fad0f7bf8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:43.216070 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f862bfb2-1719-4318-baa2-a46fad0f7bf8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:43.216541 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f862bfb2-1719-4318-baa2-a46fad0f7bf8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:43.216974 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f862bfb2-1719-4318-baa2-a46fad0f7bf8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:43.292390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c2256a1f-504f-4c98-a8fe-3bbe8111905c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:43.306598 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c2256a1f-504f-4c98-a8fe-3bbe8111905c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1313 microversion: 2.1 time: 0.526756 Aug 31 11:06:43.307497 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 80/165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:42 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1313 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:43.603144 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f862bfb2-1719-4318-baa2-a46fad0f7bf8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:43.618472 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f862bfb2-1719-4318-baa2-a46fad0f7bf8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.420533 Aug 31 11:06:43.628061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 86/166] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:43 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:44.332976 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f0a31723-219a-4373-b909-524555a3623f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:44.334536 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-f0a31723-219a-4373-b909-524555a3623f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:44.343017 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f0a31723-219a-4373-b909-524555a3623f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:44.344223 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f0a31723-219a-4373-b909-524555a3623f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:44.344971 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f0a31723-219a-4373-b909-524555a3623f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:44.345911 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f0a31723-219a-4373-b909-524555a3623f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:44.346595 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f0a31723-219a-4373-b909-524555a3623f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:44.347294 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f0a31723-219a-4373-b909-524555a3623f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:44.572370 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-f0a31723-219a-4373-b909-524555a3623f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:44.592192 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-f0a31723-219a-4373-b909-524555a3623f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1313 microversion: 2.1 time: 0.263781 Aug 31 11:06:44.593151 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 81/167] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:44 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:44.642504 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b5fbcbf7-5674-487a-8fdd-a5534000141e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:44.645228 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b5fbcbf7-5674-487a-8fdd-a5534000141e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:44.666175 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5fbcbf7-5674-487a-8fdd-a5534000141e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:44.670746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5fbcbf7-5674-487a-8fdd-a5534000141e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:44.674010 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5fbcbf7-5674-487a-8fdd-a5534000141e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:44.682120 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5fbcbf7-5674-487a-8fdd-a5534000141e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:44.683669 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5fbcbf7-5674-487a-8fdd-a5534000141e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:44.684859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5fbcbf7-5674-487a-8fdd-a5534000141e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:44.727522 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8565f833-4e5c-4245-a930-79af15003051 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:44.728981 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8565f833-4e5c-4245-a930-79af15003051 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:44.740376 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8565f833-4e5c-4245-a930-79af15003051 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:44.741337 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8565f833-4e5c-4245-a930-79af15003051 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:44.742932 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8565f833-4e5c-4245-a930-79af15003051 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:44.743832 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8565f833-4e5c-4245-a930-79af15003051 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:44.746209 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8565f833-4e5c-4245-a930-79af15003051 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:44.747530 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8565f833-4e5c-4245-a930-79af15003051 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:44.781120 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-8565f833-4e5c-4245-a930-79af15003051 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] HTTP exception thrown: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8565f833-4e5c-4245-a930-79af15003051 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Request method failure captured: Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: DELETE /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 HTTP/1.1 Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0B4PaU_6OwZ8INCTo_nUDPvaBXNRzlqt2nTqWpLe6LtuOwgbri3HDwIbmG6rVv7vTVwd0E7EXUQ-bOogFz-wfsNYMdoYbK6AIp3iPCj9X-3ZnkIpJqBzUb_R9lPGdLdQCauTKZ3XJvI3-0uIo9QZgpfoDqHDISnrTzntzvpRIAAH2o Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 0ee7c5a0b37b4192a3746ee760ecefa5 Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-DeleteServersTestJSON-1234472477 Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:06:44.786474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:06:44.787907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0ee7c5a0b37b4192a3746ee760ecefa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0ee7c5a0b37b4192a3746ee760ecefa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ee7c5a0b37b4192a3746ee760ecefa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ee7c5a0b37b4192a3746ee760ecefa5"}]}] Aug 31 11:06:44.787907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-DeleteServersTestJSON-1234472477 Aug 31 11:06:44.787907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 0ee7c5a0b37b4192a3746ee760ecefa5 Aug 31 11:06:44.787907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-DeleteServersTestJSON-1234472477 Aug 31 11:06:44.787907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-DeleteServersTestJSON-1234472477-project Aug 31 11:06:44.787907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:06:44.787907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:06:44.787907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 0517d50b405e4bce991bb22eef6076a4 Aug 31 11:06:44.787907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-DeleteServersTestJSON-1234472477-project Aug 31 11:06:44.787907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:06:44.787907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:44.787907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '50a53db1-1075-4ae2-a541-fdf0936c6809'} Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:06:44.789206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:44.791452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:06:44.794919 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8565f833-4e5c-4245-a930-79af15003051 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Returning 404 to user: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:06:44.796461 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8565f833-4e5c-4245-a930-79af15003051 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "DELETE /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 404 len: 111 microversion: 2.1 time: 0.073617 Aug 31 11:06:44.798026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 82/168] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:06:44 2022] DELETE /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:06:44.808018 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-42fa8134-bf7e-4742-b6df-1bbb423773e3 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:44.810066 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-42fa8134-bf7e-4742-b6df-1bbb423773e3 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] [instance: 50a53db1-1075-4ae2-a541-fdf0936c6809] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:44.817730 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-42fa8134-bf7e-4742-b6df-1bbb423773e3 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:44.818638 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-42fa8134-bf7e-4742-b6df-1bbb423773e3 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:44.819310 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-42fa8134-bf7e-4742-b6df-1bbb423773e3 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:44.821088 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-42fa8134-bf7e-4742-b6df-1bbb423773e3 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:44.821789 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-42fa8134-bf7e-4742-b6df-1bbb423773e3 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:44.822421 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-42fa8134-bf7e-4742-b6df-1bbb423773e3 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:44.839845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-42fa8134-bf7e-4742-b6df-1bbb423773e3 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] HTTP exception thrown: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-42fa8134-bf7e-4742-b6df-1bbb423773e3 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Request method failure captured: Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 HTTP/1.1 Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0B4PaU_6OwZ8INCTo_nUDPvaBXNRzlqt2nTqWpLe6LtuOwgbri3HDwIbmG6rVv7vTVwd0E7EXUQ-bOogFz-wfsNYMdoYbK6AIp3iPCj9X-3ZnkIpJqBzUb_R9lPGdLdQCauTKZ3XJvI3-0uIo9QZgpfoDqHDISnrTzntzvpRIAAH2o Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 0ee7c5a0b37b4192a3746ee760ecefa5 Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-DeleteServersTestJSON-1234472477 Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:06:44.842444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:06:44.843636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0ee7c5a0b37b4192a3746ee760ecefa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0ee7c5a0b37b4192a3746ee760ecefa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ee7c5a0b37b4192a3746ee760ecefa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ee7c5a0b37b4192a3746ee760ecefa5"}]}] Aug 31 11:06:44.843636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-DeleteServersTestJSON-1234472477 Aug 31 11:06:44.843636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 0ee7c5a0b37b4192a3746ee760ecefa5 Aug 31 11:06:44.843636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-DeleteServersTestJSON-1234472477 Aug 31 11:06:44.843636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-DeleteServersTestJSON-1234472477-project Aug 31 11:06:44.843636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:06:44.843636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:06:44.843636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 0517d50b405e4bce991bb22eef6076a4 Aug 31 11:06:44.843636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-DeleteServersTestJSON-1234472477-project Aug 31 11:06:44.843636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:06:44.843636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:44.843636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '50a53db1-1075-4ae2-a541-fdf0936c6809'} Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:06:44.844758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. Aug 31 11:06:44.845781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:06:44.847906 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-42fa8134-bf7e-4742-b6df-1bbb423773e3 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] Returning 404 to user: Instance 50a53db1-1075-4ae2-a541-fdf0936c6809 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:06:44.849393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-42fa8134-bf7e-4742-b6df-1bbb423773e3 tempest-DeleteServersTestJSON-1234472477 tempest-DeleteServersTestJSON-1234472477-project] 10.222.0.20 "GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809" status: 404 len: 111 microversion: 2.1 time: 0.047100 Aug 31 11:06:44.853671 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 83/169] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:44 2022] GET /compute/v2.1/servers/50a53db1-1075-4ae2-a541-fdf0936c6809 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:06:45.237844 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b5fbcbf7-5674-487a-8fdd-a5534000141e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:45.249440 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b5fbcbf7-5674-487a-8fdd-a5534000141e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.610788 Aug 31 11:06:45.251295 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 87/170] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:44 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:45.679857 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d54748be-ed14-4ad8-b961-544d024f7bad tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:45.685585 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d54748be-ed14-4ad8-b961-544d024f7bad tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:45.740442 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d54748be-ed14-4ad8-b961-544d024f7bad tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:45.741715 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d54748be-ed14-4ad8-b961-544d024f7bad tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:45.745044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d54748be-ed14-4ad8-b961-544d024f7bad tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:45.748256 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d54748be-ed14-4ad8-b961-544d024f7bad tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:45.749341 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d54748be-ed14-4ad8-b961-544d024f7bad tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:45.758407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d54748be-ed14-4ad8-b961-544d024f7bad tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:46.268390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d54748be-ed14-4ad8-b961-544d024f7bad tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:46.282161 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ac45164a-2afd-4bc4-992f-6274ec8e3988 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:46.284312 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ac45164a-2afd-4bc4-992f-6274ec8e3988 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:46.311952 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d54748be-ed14-4ad8-b961-544d024f7bad tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1313 microversion: 2.1 time: 0.663816 Aug 31 11:06:46.315099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 84/171] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:45 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1313 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:46.318421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac45164a-2afd-4bc4-992f-6274ec8e3988 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:46.329687 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac45164a-2afd-4bc4-992f-6274ec8e3988 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:46.336632 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac45164a-2afd-4bc4-992f-6274ec8e3988 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:46.338002 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac45164a-2afd-4bc4-992f-6274ec8e3988 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:46.340442 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac45164a-2afd-4bc4-992f-6274ec8e3988 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:46.340952 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac45164a-2afd-4bc4-992f-6274ec8e3988 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:46.867610 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ac45164a-2afd-4bc4-992f-6274ec8e3988 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:46.885610 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ac45164a-2afd-4bc4-992f-6274ec8e3988 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.611683 Aug 31 11:06:46.887705 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 88/172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:46 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:47.180068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-52139cc1-b98c-488f-adde-c26b5e8288f8 req-01de4990-2aa1-4cd3-a56f-049ffa4b4fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bd184d-2701-4cb1-b758-b234dcd861a1", "name": "network-vif-plugged", "status": "completed", "tag": "04b519bc-23c9-4935-a87b-13b2c0931560"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:47.211232 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-52139cc1-b98c-488f-adde-c26b5e8288f8 req-01de4990-2aa1-4cd3-a56f-049ffa4b4fc2 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:47.220186 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-52139cc1-b98c-488f-adde-c26b5e8288f8 req-01de4990-2aa1-4cd3-a56f-049ffa4b4fc2 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:47.220821 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-52139cc1-b98c-488f-adde-c26b5e8288f8 req-01de4990-2aa1-4cd3-a56f-049ffa4b4fc2 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:47.272845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-52139cc1-b98c-488f-adde-c26b5e8288f8 req-01de4990-2aa1-4cd3-a56f-049ffa4b4fc2 service nova] Creating event network-vif-plugged:04b519bc-23c9-4935-a87b-13b2c0931560 for instance 42bd184d-2701-4cb1-b758-b234dcd861a1 on hv-cinder-85535 Aug 31 11:06:47.286734 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-52139cc1-b98c-488f-adde-c26b5e8288f8 req-01de4990-2aa1-4cd3-a56f-049ffa4b4fc2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110259 Aug 31 11:06:47.287364 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 85/173] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:06:47.340615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-46131691-095c-4fce-b089-07d32b98e1ca tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:47.342753 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-46131691-095c-4fce-b089-07d32b98e1ca tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:47.353424 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46131691-095c-4fce-b089-07d32b98e1ca tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:47.365254 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46131691-095c-4fce-b089-07d32b98e1ca tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:47.367208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46131691-095c-4fce-b089-07d32b98e1ca tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:47.373174 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46131691-095c-4fce-b089-07d32b98e1ca tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:47.374753 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46131691-095c-4fce-b089-07d32b98e1ca tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:47.377638 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46131691-095c-4fce-b089-07d32b98e1ca tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:47.908492 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5375d99c-d0e9-4100-be30-16579be3e832 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:47.909416 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-5375d99c-d0e9-4100-be30-16579be3e832 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:47.923025 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5375d99c-d0e9-4100-be30-16579be3e832 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:47.925300 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5375d99c-d0e9-4100-be30-16579be3e832 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:47.927120 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5375d99c-d0e9-4100-be30-16579be3e832 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:47.930956 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5375d99c-d0e9-4100-be30-16579be3e832 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:47.931870 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5375d99c-d0e9-4100-be30-16579be3e832 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:47.932581 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5375d99c-d0e9-4100-be30-16579be3e832 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:47.990171 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-46131691-095c-4fce-b089-07d32b98e1ca tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:48.003417 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-46131691-095c-4fce-b089-07d32b98e1ca tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1313 microversion: 2.1 time: 0.668905 Aug 31 11:06:48.004072 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 89/174] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:47 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1313 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:48.426201 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5375d99c-d0e9-4100-be30-16579be3e832 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:48.438402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-5375d99c-d0e9-4100-be30-16579be3e832 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.534118 Aug 31 11:06:48.446149 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 86/175] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:47 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:49.050662 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-16fb872e-1b63-40b6-b61c-76778ba93b67 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:49.055968 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-16fb872e-1b63-40b6-b61c-76778ba93b67 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:49.072898 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-16fb872e-1b63-40b6-b61c-76778ba93b67 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:49.078441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-16fb872e-1b63-40b6-b61c-76778ba93b67 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:49.083084 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-16fb872e-1b63-40b6-b61c-76778ba93b67 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:49.084307 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-16fb872e-1b63-40b6-b61c-76778ba93b67 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:49.086708 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-16fb872e-1b63-40b6-b61c-76778ba93b67 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:49.087376 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-16fb872e-1b63-40b6-b61c-76778ba93b67 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:49.471800 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-51ca31f2-015f-4d48-b46d-4d3b84be088d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:49.477395 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-51ca31f2-015f-4d48-b46d-4d3b84be088d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:49.498292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:49.502117 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-51ca31f2-015f-4d48-b46d-4d3b84be088d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:49.504575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-51ca31f2-015f-4d48-b46d-4d3b84be088d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:49.505417 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-51ca31f2-015f-4d48-b46d-4d3b84be088d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:49.513811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-51ca31f2-015f-4d48-b46d-4d3b84be088d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:49.514981 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-51ca31f2-015f-4d48-b46d-4d3b84be088d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:49.517391 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-51ca31f2-015f-4d48-b46d-4d3b84be088d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:49.911691 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-16fb872e-1b63-40b6-b61c-76778ba93b67 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:49.921745 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-16fb872e-1b63-40b6-b61c-76778ba93b67 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1313 microversion: 2.1 time: 0.876007 Aug 31 11:06:49.930120 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 90/176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:49 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1313 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:50.063423 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-51ca31f2-015f-4d48-b46d-4d3b84be088d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:50.086819 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-51ca31f2-015f-4d48-b46d-4d3b84be088d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.620390 Aug 31 11:06:50.088105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 87/177] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:49 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:50.944353 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d3a7196f-ca83-44b4-866d-8ed4740e44c4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:50.947428 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d3a7196f-ca83-44b4-866d-8ed4740e44c4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:50.963803 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3a7196f-ca83-44b4-866d-8ed4740e44c4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:50.966170 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3a7196f-ca83-44b4-866d-8ed4740e44c4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:50.968692 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3a7196f-ca83-44b4-866d-8ed4740e44c4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:50.975024 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3a7196f-ca83-44b4-866d-8ed4740e44c4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:50.975600 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3a7196f-ca83-44b4-866d-8ed4740e44c4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:50.976077 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3a7196f-ca83-44b4-866d-8ed4740e44c4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:51.112587 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1257ac17-1306-4ad7-9697-84b6f6f7bf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:51.113833 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-1257ac17-1306-4ad7-9697-84b6f6f7bf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:51.127182 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1257ac17-1306-4ad7-9697-84b6f6f7bf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:51.128314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1257ac17-1306-4ad7-9697-84b6f6f7bf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:51.129487 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1257ac17-1306-4ad7-9697-84b6f6f7bf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:51.132403 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1257ac17-1306-4ad7-9697-84b6f6f7bf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:51.133356 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1257ac17-1306-4ad7-9697-84b6f6f7bf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:51.134659 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1257ac17-1306-4ad7-9697-84b6f6f7bf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:51.321705 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d3a7196f-ca83-44b4-866d-8ed4740e44c4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:51.344358 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d3a7196f-ca83-44b4-866d-8ed4740e44c4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1497 microversion: 2.1 time: 0.405289 Aug 31 11:06:51.346000 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 91/178] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:50 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1497 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:51.786647 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-1257ac17-1306-4ad7-9697-84b6f6f7bf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:51.801733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-1257ac17-1306-4ad7-9697-84b6f6f7bf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.693797 Aug 31 11:06:51.804757 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 88/179] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:51 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:52.095494 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a577a0b9-bed0-4be8-a8ca-879be9654671 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:52.096334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a577a0b9-bed0-4be8-a8ca-879be9654671 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:52.108683 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a577a0b9-bed0-4be8-a8ca-879be9654671 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:52.109207 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a577a0b9-bed0-4be8-a8ca-879be9654671 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:52.109658 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a577a0b9-bed0-4be8-a8ca-879be9654671 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:52.110404 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a577a0b9-bed0-4be8-a8ca-879be9654671 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:52.110864 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a577a0b9-bed0-4be8-a8ca-879be9654671 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:52.111307 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a577a0b9-bed0-4be8-a8ca-879be9654671 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:52.256511 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a577a0b9-bed0-4be8-a8ca-879be9654671 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:06:52.587246 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a577a0b9-bed0-4be8-a8ca-879be9654671 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 204 len: 0 microversion: 2.1 time: 0.496751 Aug 31 11:06:52.594127 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 92/180] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:06:52 2022] DELETE /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:06:52.625337 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-db02f834-43e0-4b38-af6f-7f50f1c49cab tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:52.634028 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-db02f834-43e0-4b38-af6f-7f50f1c49cab tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:52.688689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-db02f834-43e0-4b38-af6f-7f50f1c49cab tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:52.689513 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-db02f834-43e0-4b38-af6f-7f50f1c49cab tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:52.690569 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-db02f834-43e0-4b38-af6f-7f50f1c49cab tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:52.693356 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-db02f834-43e0-4b38-af6f-7f50f1c49cab tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:52.694343 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-db02f834-43e0-4b38-af6f-7f50f1c49cab tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:52.694943 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-db02f834-43e0-4b38-af6f-7f50f1c49cab tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:52.832591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ead06f5c-8d0c-4508-89b0-7d920f149e54 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:52.833623 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ead06f5c-8d0c-4508-89b0-7d920f149e54 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:52.858410 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ead06f5c-8d0c-4508-89b0-7d920f149e54 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:52.860729 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ead06f5c-8d0c-4508-89b0-7d920f149e54 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:52.861233 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ead06f5c-8d0c-4508-89b0-7d920f149e54 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:52.862110 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ead06f5c-8d0c-4508-89b0-7d920f149e54 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:52.867045 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ead06f5c-8d0c-4508-89b0-7d920f149e54 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:52.867495 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ead06f5c-8d0c-4508-89b0-7d920f149e54 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:53.153885 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-db02f834-43e0-4b38-af6f-7f50f1c49cab tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:53.165842 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-db02f834-43e0-4b38-af6f-7f50f1c49cab tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1503 microversion: 2.1 time: 0.566781 Aug 31 11:06:53.169707 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 89/181] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:52 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1503 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:53.310481 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ead06f5c-8d0c-4508-89b0-7d920f149e54 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:53.321119 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ead06f5c-8d0c-4508-89b0-7d920f149e54 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.495036 Aug 31 11:06:53.321948 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 93/182] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:52 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:54.192677 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-23100a73-e2ae-410a-b0e0-ec43914af89d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:54.194507 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-23100a73-e2ae-410a-b0e0-ec43914af89d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:54.209578 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-23100a73-e2ae-410a-b0e0-ec43914af89d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:54.210321 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-23100a73-e2ae-410a-b0e0-ec43914af89d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:54.212163 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-23100a73-e2ae-410a-b0e0-ec43914af89d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:54.214702 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-23100a73-e2ae-410a-b0e0-ec43914af89d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:54.215338 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-23100a73-e2ae-410a-b0e0-ec43914af89d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:54.216298 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-23100a73-e2ae-410a-b0e0-ec43914af89d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:54.345019 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-97add4df-2838-4428-87b7-fcde0e71433f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:54.346825 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-97add4df-2838-4428-87b7-fcde0e71433f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:54.369421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-97add4df-2838-4428-87b7-fcde0e71433f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:54.370231 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-97add4df-2838-4428-87b7-fcde0e71433f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:54.375454 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-97add4df-2838-4428-87b7-fcde0e71433f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:54.376872 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-97add4df-2838-4428-87b7-fcde0e71433f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:54.380961 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-97add4df-2838-4428-87b7-fcde0e71433f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:54.383363 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-97add4df-2838-4428-87b7-fcde0e71433f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:54.749040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-97add4df-2838-4428-87b7-fcde0e71433f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:54.761832 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-97add4df-2838-4428-87b7-fcde0e71433f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.422651 Aug 31 11:06:54.762799 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 94/183] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:54 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:54.790969 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-23100a73-e2ae-410a-b0e0-ec43914af89d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:54.801513 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-23100a73-e2ae-410a-b0e0-ec43914af89d tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1503 microversion: 2.1 time: 0.614109 Aug 31 11:06:54.803515 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 90/184] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:54 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1503 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:55.290672 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-6ed486cb-167c-4857-94db-9c1b7ae588da req-527dc46b-4e71-4bbd-b609-5acfc5239e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bd184d-2701-4cb1-b758-b234dcd861a1", "name": "network-vif-deleted", "tag": "04b519bc-23c9-4935-a87b-13b2c0931560"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:55.311879 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-6ed486cb-167c-4857-94db-9c1b7ae588da req-527dc46b-4e71-4bbd-b609-5acfc5239e77 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:55.313849 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-6ed486cb-167c-4857-94db-9c1b7ae588da req-527dc46b-4e71-4bbd-b609-5acfc5239e77 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:55.314495 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-6ed486cb-167c-4857-94db-9c1b7ae588da req-527dc46b-4e71-4bbd-b609-5acfc5239e77 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:55.320837 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:55.332088 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-6ed486cb-167c-4857-94db-9c1b7ae588da req-527dc46b-4e71-4bbd-b609-5acfc5239e77 service nova] Creating event network-vif-deleted:04b519bc-23c9-4935-a87b-13b2c0931560 for instance 42bd184d-2701-4cb1-b758-b234dcd861a1 on hv-cinder-85535 Aug 31 11:06:55.341477 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-6ed486cb-167c-4857-94db-9c1b7ae588da req-527dc46b-4e71-4bbd-b609-5acfc5239e77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055745 Aug 31 11:06:55.348912 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 95/185] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:06:55.795469 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-89cdff2e-0660-48b1-9a75-295e50632422 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:55.800709 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-89cdff2e-0660-48b1-9a75-295e50632422 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:55.829182 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:55.829392 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-89cdff2e-0660-48b1-9a75-295e50632422 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:55.830798 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:55.830981 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-89cdff2e-0660-48b1-9a75-295e50632422 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:55.831625 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-89cdff2e-0660-48b1-9a75-295e50632422 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:55.834325 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-89cdff2e-0660-48b1-9a75-295e50632422 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:55.837194 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-89cdff2e-0660-48b1-9a75-295e50632422 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:55.840746 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-89cdff2e-0660-48b1-9a75-295e50632422 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:55.843419 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:55.844225 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:55.845502 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:55.846490 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:55.847515 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:55.848204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:55.906376 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:55.907883 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:55.908371 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:55.910303 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lazy-loading 'fault' on Instance uuid 42bd184d-2701-4cb1-b758-b234dcd861a1 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:06:56.040415 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:56.052876 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-69253eee-d456-447d-acb4-d7d4950719da tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 200 len: 1303 microversion: 2.1 time: 0.233681 Aug 31 11:06:56.054078 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 96/186] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:55 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:56.241732 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-89cdff2e-0660-48b1-9a75-295e50632422 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:56.259087 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-89cdff2e-0660-48b1-9a75-295e50632422 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.471608 Aug 31 11:06:56.259980 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 91/187] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:55 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:57.078999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-80153ee5-965c-48c0-a374-eef0971c6ba4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:57.079638 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-80153ee5-965c-48c0-a374-eef0971c6ba4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 42bd184d-2701-4cb1-b758-b234dcd861a1] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:57.095104 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:57.099778 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-80153ee5-965c-48c0-a374-eef0971c6ba4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:57.102225 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-80153ee5-965c-48c0-a374-eef0971c6ba4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:57.104257 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-80153ee5-965c-48c0-a374-eef0971c6ba4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:57.107132 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-80153ee5-965c-48c0-a374-eef0971c6ba4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:57.108752 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-80153ee5-965c-48c0-a374-eef0971c6ba4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:57.110589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-80153ee5-965c-48c0-a374-eef0971c6ba4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:57.174636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-80153ee5-965c-48c0-a374-eef0971c6ba4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] HTTP exception thrown: Instance 42bd184d-2701-4cb1-b758-b234dcd861a1 could not be found. Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-80153ee5-965c-48c0-a374-eef0971c6ba4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Request method failure captured: Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 HTTP/1.1 Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0Cx5m4YhsEdh3-idPUNEOJ5PXAbYTSnoPvINYvO-gQfYDioQky4u9xz1qT61R3F77K2alLcRuFjkZP-lXuidX1U_qh2MPeGtoSduUFY-R0q2bbI8bWaZadZJ0jb9lWeEJZUTYRSIVE4hoLUt3XlNPvZu2_liW5wj0p5rIUXEYHrnQI Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: b2365f1500c5405aab2ea6e892fbb832 Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-VolumesActionsTest-230784548 Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:06:57.176893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:06:57.178636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b2365f1500c5405aab2ea6e892fbb832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b2365f1500c5405aab2ea6e892fbb832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b2365f1500c5405aab2ea6e892fbb832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b2365f1500c5405aab2ea6e892fbb832"}]}] Aug 31 11:06:57.178636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-VolumesActionsTest-230784548 Aug 31 11:06:57.178636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: b2365f1500c5405aab2ea6e892fbb832 Aug 31 11:06:57.178636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-VolumesActionsTest-230784548 Aug 31 11:06:57.178636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-VolumesActionsTest-230784548-project Aug 31 11:06:57.178636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:06:57.178636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:06:57.178636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: fe027aad062342688c587428f2bfbfe7 Aug 31 11:06:57.178636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-VolumesActionsTest-230784548-project Aug 31 11:06:57.178636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:06:57.178636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance 42bd184d-2701-4cb1-b758-b234dcd861a1 could not be found. Aug 31 11:06:57.178636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '42bd184d-2701-4cb1-b758-b234dcd861a1'} Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42bd184d-2701-4cb1-b758-b234dcd861a1 could not be found. Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:06:57.179602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42bd184d-2701-4cb1-b758-b234dcd861a1 could not be found. Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42bd184d-2701-4cb1-b758-b234dcd861a1 could not be found. Aug 31 11:06:57.181081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:06:57.182279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-80153ee5-965c-48c0-a374-eef0971c6ba4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Returning 404 to user: Instance 42bd184d-2701-4cb1-b758-b234dcd861a1 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:06:57.182279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-80153ee5-965c-48c0-a374-eef0971c6ba4 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1" status: 404 len: 111 microversion: 2.1 time: 0.106274 Aug 31 11:06:57.183015 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 97/188] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:57 2022] GET /compute/v2.1/servers/42bd184d-2701-4cb1-b758-b234dcd861a1 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:06:57.280559 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d09a1958-8cff-4e87-89ac-98df3824cebd tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:57.281191 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d09a1958-8cff-4e87-89ac-98df3824cebd tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:57.294691 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d09a1958-8cff-4e87-89ac-98df3824cebd tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:57.295190 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d09a1958-8cff-4e87-89ac-98df3824cebd tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:57.295629 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d09a1958-8cff-4e87-89ac-98df3824cebd tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:57.303945 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d09a1958-8cff-4e87-89ac-98df3824cebd tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:57.304565 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d09a1958-8cff-4e87-89ac-98df3824cebd tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:57.308629 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d09a1958-8cff-4e87-89ac-98df3824cebd tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:57.458437 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-531523375", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "networks": [{"uuid": "ede39734-7054-4d40-88a0-7e74e8650ae1"}]}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:06:57.588337 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] validate_networks() for [('ede39734-7054-4d40-88a0-7e74e8650ae1', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:06:57.609545 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d09a1958-8cff-4e87-89ac-98df3824cebd tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:57.648979 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d09a1958-8cff-4e87-89ac-98df3824cebd tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.365621 Aug 31 11:06:57.652887 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 92/189] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:57 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:06:58.680251 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-eb23b7a0-b80a-4ec9-8473-46e58c0ee94d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:58.681650 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-eb23b7a0-b80a-4ec9-8473-46e58c0ee94d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:58.694781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eb23b7a0-b80a-4ec9-8473-46e58c0ee94d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:58.695388 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eb23b7a0-b80a-4ec9-8473-46e58c0ee94d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:58.701068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eb23b7a0-b80a-4ec9-8473-46e58c0ee94d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:58.719136 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eb23b7a0-b80a-4ec9-8473-46e58c0ee94d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:58.719906 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eb23b7a0-b80a-4ec9-8473-46e58c0ee94d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:58.720393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eb23b7a0-b80a-4ec9-8473-46e58c0ee94d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:58.910911 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:06:58.912159 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:06:58.912918 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:06:58.914416 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:06:58.915615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:06:58.953460 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:58.954555 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:58.957226 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:58.959711 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:06:58.962023 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:06:58.963910 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:06:59.013348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-eb23b7a0-b80a-4ec9-8473-46e58c0ee94d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:59.026142 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-eb23b7a0-b80a-4ec9-8473-46e58c0ee94d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.350711 Aug 31 11:06:59.027678 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Getting quotas for project b2365f1500c5405aab2ea6e892fbb832. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:06:59.030431 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 93/190] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:58 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:06:59.038166 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Getting quotas for user fe027aad062342688c587428f2bfbfe7 and project b2365f1500c5405aab2ea6e892fbb832. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:06:59.074956 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:06:59.085104 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:06:59.272714 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-cc5e3a66-f885-4a84-b0a1-32510cfe4a53 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.819317 Aug 31 11:06:59.285355 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 98/191] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:06:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 11:06:59.295500 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-de260191-fe4e-42a3-9ebe-54ad71b75fd1 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:06:59.296542 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-de260191-fe4e-42a3-9ebe-54ad71b75fd1 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:06:59.410010 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-de260191-fe4e-42a3-9ebe-54ad71b75fd1 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:06:59.424480 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-de260191-fe4e-42a3-9ebe-54ad71b75fd1 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1213 microversion: 2.1 time: 0.133699 Aug 31 11:06:59.425610 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 94/192] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:06:59 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:00.055928 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c65ec0e6-5022-4c11-8f20-6723cc60b334 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:00.057083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c65ec0e6-5022-4c11-8f20-6723cc60b334 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:00.095329 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c65ec0e6-5022-4c11-8f20-6723cc60b334 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:00.108970 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c65ec0e6-5022-4c11-8f20-6723cc60b334 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:00.111736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c65ec0e6-5022-4c11-8f20-6723cc60b334 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:00.114500 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c65ec0e6-5022-4c11-8f20-6723cc60b334 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:00.118879 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c65ec0e6-5022-4c11-8f20-6723cc60b334 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:00.119136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c65ec0e6-5022-4c11-8f20-6723cc60b334 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:00.447374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d3e12530-0c07-4877-91f6-2f724de89216 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:00.448704 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d3e12530-0c07-4877-91f6-2f724de89216 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:00.461951 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3e12530-0c07-4877-91f6-2f724de89216 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:00.462522 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3e12530-0c07-4877-91f6-2f724de89216 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:00.464487 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3e12530-0c07-4877-91f6-2f724de89216 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:00.466282 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3e12530-0c07-4877-91f6-2f724de89216 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:00.466784 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3e12530-0c07-4877-91f6-2f724de89216 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:00.467263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3e12530-0c07-4877-91f6-2f724de89216 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:00.559176 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d3e12530-0c07-4877-91f6-2f724de89216 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:00.572000 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d3e12530-0c07-4877-91f6-2f724de89216 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1217 microversion: 2.1 time: 0.128764 Aug 31 11:07:00.574183 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 95/193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:00 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:00.888548 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c65ec0e6-5022-4c11-8f20-6723cc60b334 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:00.908634 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c65ec0e6-5022-4c11-8f20-6723cc60b334 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1522 microversion: 2.1 time: 0.859009 Aug 31 11:07:00.911125 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 99/194] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:00 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1522 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:01.596564 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8810ecb8-f823-4d1a-a34c-df7ce5513961 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:01.598005 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8810ecb8-f823-4d1a-a34c-df7ce5513961 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:01.610801 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8810ecb8-f823-4d1a-a34c-df7ce5513961 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:01.616707 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8810ecb8-f823-4d1a-a34c-df7ce5513961 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:01.617179 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8810ecb8-f823-4d1a-a34c-df7ce5513961 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:01.618090 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8810ecb8-f823-4d1a-a34c-df7ce5513961 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:01.618855 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8810ecb8-f823-4d1a-a34c-df7ce5513961 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:01.619431 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8810ecb8-f823-4d1a-a34c-df7ce5513961 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:01.752570 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8810ecb8-f823-4d1a-a34c-df7ce5513961 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:01.768831 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8810ecb8-f823-4d1a-a34c-df7ce5513961 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1265 microversion: 2.1 time: 0.177467 Aug 31 11:07:01.770130 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 96/195] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:01 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:01.934491 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9b8b8a20-f87f-44e6-84ca-ccd10ac7e73e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:01.937088 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9b8b8a20-f87f-44e6-84ca-ccd10ac7e73e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:01.970523 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9b8b8a20-f87f-44e6-84ca-ccd10ac7e73e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:01.971380 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9b8b8a20-f87f-44e6-84ca-ccd10ac7e73e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:01.974416 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9b8b8a20-f87f-44e6-84ca-ccd10ac7e73e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:01.975567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9b8b8a20-f87f-44e6-84ca-ccd10ac7e73e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:01.976449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9b8b8a20-f87f-44e6-84ca-ccd10ac7e73e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:01.977490 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9b8b8a20-f87f-44e6-84ca-ccd10ac7e73e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:02.336655 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9b8b8a20-f87f-44e6-84ca-ccd10ac7e73e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:02.346236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9b8b8a20-f87f-44e6-84ca-ccd10ac7e73e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1502 microversion: 2.1 time: 0.417959 Aug 31 11:07:02.346872 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 100/196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:01 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1502 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:02.379737 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7c056a36-7d47-4366-9369-f5c9d370c2a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:02.379941 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-7c056a36-7d47-4366-9369-f5c9d370c2a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:02.406475 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7c056a36-7d47-4366-9369-f5c9d370c2a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:02.408135 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7c056a36-7d47-4366-9369-f5c9d370c2a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:02.411447 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7c056a36-7d47-4366-9369-f5c9d370c2a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:02.414391 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7c056a36-7d47-4366-9369-f5c9d370c2a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:02.418265 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7c056a36-7d47-4366-9369-f5c9d370c2a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:02.419825 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7c056a36-7d47-4366-9369-f5c9d370c2a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:02.790890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3a72cbed-02ec-45fe-bc07-b716ef6592f2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:02.791498 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3a72cbed-02ec-45fe-bc07-b716ef6592f2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:02.811851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3a72cbed-02ec-45fe-bc07-b716ef6592f2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:02.816995 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3a72cbed-02ec-45fe-bc07-b716ef6592f2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:02.826301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3a72cbed-02ec-45fe-bc07-b716ef6592f2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:02.832413 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3a72cbed-02ec-45fe-bc07-b716ef6592f2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:02.839134 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3a72cbed-02ec-45fe-bc07-b716ef6592f2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:02.839935 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3a72cbed-02ec-45fe-bc07-b716ef6592f2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:03.006799 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7c056a36-7d47-4366-9369-f5c9d370c2a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:03.017180 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7c056a36-7d47-4366-9369-f5c9d370c2a0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1514 microversion: 2.1 time: 0.648663 Aug 31 11:07:03.021140 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 97/197] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:02 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1514 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:03.269647 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3a72cbed-02ec-45fe-bc07-b716ef6592f2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:03.282273 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3a72cbed-02ec-45fe-bc07-b716ef6592f2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1271 microversion: 2.1 time: 0.494962 Aug 31 11:07:03.283994 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 101/198] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:02 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1271 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:04.307931 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-47015d60-ec43-4e06-9077-e0cd42babd7f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:04.308709 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-47015d60-ec43-4e06-9077-e0cd42babd7f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:04.335434 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-47015d60-ec43-4e06-9077-e0cd42babd7f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:04.335875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-47015d60-ec43-4e06-9077-e0cd42babd7f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:04.336356 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-47015d60-ec43-4e06-9077-e0cd42babd7f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:04.341726 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-47015d60-ec43-4e06-9077-e0cd42babd7f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:04.342221 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-47015d60-ec43-4e06-9077-e0cd42babd7f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:04.342660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-47015d60-ec43-4e06-9077-e0cd42babd7f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:04.883822 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-47015d60-ec43-4e06-9077-e0cd42babd7f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:04.899354 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-47015d60-ec43-4e06-9077-e0cd42babd7f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1313 microversion: 2.1 time: 0.595936 Aug 31 11:07:04.903478 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 98/199] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:04 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:05.051114 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1653695c-ba81-4991-9e9d-f017ed77a433 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:05.054985 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1653695c-ba81-4991-9e9d-f017ed77a433 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:05.076911 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1653695c-ba81-4991-9e9d-f017ed77a433 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:05.085965 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1653695c-ba81-4991-9e9d-f017ed77a433 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:05.086907 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1653695c-ba81-4991-9e9d-f017ed77a433 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:05.089658 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1653695c-ba81-4991-9e9d-f017ed77a433 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:05.093463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1653695c-ba81-4991-9e9d-f017ed77a433 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:05.094380 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1653695c-ba81-4991-9e9d-f017ed77a433 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:05.120737 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-71fb9a43-8264-4c41-9b06-48942fc9916c req-191ef2a1-566b-4d99-bcf8-b81e237a7875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c128235-7d40-4faf-a1ae-ee179935df87", "tag": "429c79d2-9753-444a-a907-6018680b4614"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:05.148286 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-71fb9a43-8264-4c41-9b06-48942fc9916c req-191ef2a1-566b-4d99-bcf8-b81e237a7875 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:05.161805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-71fb9a43-8264-4c41-9b06-48942fc9916c req-191ef2a1-566b-4d99-bcf8-b81e237a7875 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:05.162783 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-71fb9a43-8264-4c41-9b06-48942fc9916c req-191ef2a1-566b-4d99-bcf8-b81e237a7875 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:05.211466 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-1653695c-ba81-4991-9e9d-f017ed77a433 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lazy-loading 'flavor' on Instance uuid fdc9445a-04e3-40f8-a633-1a8cfa00c35e {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:07:05.221197 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-71fb9a43-8264-4c41-9b06-48942fc9916c req-191ef2a1-566b-4d99-bcf8-b81e237a7875 service nova] Creating event network-changed:429c79d2-9753-444a-a907-6018680b4614 for instance 9c128235-7d40-4faf-a1ae-ee179935df87 on hv-cinder-85535 Aug 31 11:07:05.236511 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-71fb9a43-8264-4c41-9b06-48942fc9916c req-191ef2a1-566b-4d99-bcf8-b81e237a7875 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117087 Aug 31 11:07:05.244131 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 99/200] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:07:05.601440 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1653695c-ba81-4991-9e9d-f017ed77a433 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "POST /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e/action" status: 200 len: 32 microversion: 2.1 time: 0.554443 Aug 31 11:07:05.611780 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 102/201] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:07:05 2022] POST /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e/action => generated 32 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:07:05.622324 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9fedf5f7-01a8-4ff0-9152-756049e0f90a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:05.623201 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-9fedf5f7-01a8-4ff0-9152-756049e0f90a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:05.645925 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9fedf5f7-01a8-4ff0-9152-756049e0f90a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:05.650058 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9fedf5f7-01a8-4ff0-9152-756049e0f90a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:05.650542 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9fedf5f7-01a8-4ff0-9152-756049e0f90a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:05.658307 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9fedf5f7-01a8-4ff0-9152-756049e0f90a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:05.660813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9fedf5f7-01a8-4ff0-9152-756049e0f90a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:05.661266 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9fedf5f7-01a8-4ff0-9152-756049e0f90a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:05.686636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=100 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:05.926350 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-472d2bc6-c951-47e3-81c9-13294d7058f3 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:05.927241 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-472d2bc6-c951-47e3-81c9-13294d7058f3 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:05.941812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-472d2bc6-c951-47e3-81c9-13294d7058f3 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:05.942790 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-472d2bc6-c951-47e3-81c9-13294d7058f3 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:05.943446 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-472d2bc6-c951-47e3-81c9-13294d7058f3 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:05.945803 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-472d2bc6-c951-47e3-81c9-13294d7058f3 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:05.951277 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-472d2bc6-c951-47e3-81c9-13294d7058f3 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:05.952076 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-472d2bc6-c951-47e3-81c9-13294d7058f3 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:06.258329 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-9fedf5f7-01a8-4ff0-9152-756049e0f90a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:06.267542 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-9fedf5f7-01a8-4ff0-9152-756049e0f90a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.654133 Aug 31 11:07:06.269396 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 100/202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:05 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:06.275028 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-727845fb-2369-4915-a56f-0013fdd489ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:06.279656 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-727845fb-2369-4915-a56f-0013fdd489ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:06.296449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-727845fb-2369-4915-a56f-0013fdd489ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:06.297486 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-727845fb-2369-4915-a56f-0013fdd489ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:06.298081 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-727845fb-2369-4915-a56f-0013fdd489ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:06.299070 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-727845fb-2369-4915-a56f-0013fdd489ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:06.299690 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-727845fb-2369-4915-a56f-0013fdd489ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:06.300379 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-727845fb-2369-4915-a56f-0013fdd489ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:06.338077 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-727845fb-2369-4915-a56f-0013fdd489ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/ips" status: 200 len: 149 microversion: 2.1 time: 0.067345 Aug 31 11:07:06.350803 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 101/203] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 11:07:06 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/ips => generated 149 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:06.465710 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-472d2bc6-c951-47e3-81c9-13294d7058f3 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:06.478658 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-472d2bc6-c951-47e3-81c9-13294d7058f3 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1313 microversion: 2.1 time: 0.557414 Aug 31 11:07:06.498182 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 103/204] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:05 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:07:07.299708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a7256a5d-6c5d-41a7-851a-f9828ad370f2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:07.301847 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a7256a5d-6c5d-41a7-851a-f9828ad370f2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:07.328733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a7256a5d-6c5d-41a7-851a-f9828ad370f2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:07.329661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a7256a5d-6c5d-41a7-851a-f9828ad370f2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:07.332464 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a7256a5d-6c5d-41a7-851a-f9828ad370f2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:07.333401 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a7256a5d-6c5d-41a7-851a-f9828ad370f2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:07.334015 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a7256a5d-6c5d-41a7-851a-f9828ad370f2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:07.339919 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a7256a5d-6c5d-41a7-851a-f9828ad370f2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:07.512221 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-04c55bca-94a8-4209-b2aa-9b0e868b340c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:07.513767 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-04c55bca-94a8-4209-b2aa-9b0e868b340c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:07.528752 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-04c55bca-94a8-4209-b2aa-9b0e868b340c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:07.533011 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-04c55bca-94a8-4209-b2aa-9b0e868b340c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:07.533750 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-04c55bca-94a8-4209-b2aa-9b0e868b340c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:07.535050 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-04c55bca-94a8-4209-b2aa-9b0e868b340c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:07.537596 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-04c55bca-94a8-4209-b2aa-9b0e868b340c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:07.538383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-04c55bca-94a8-4209-b2aa-9b0e868b340c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:08.274632 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-04c55bca-94a8-4209-b2aa-9b0e868b340c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:08.289195 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-04c55bca-94a8-4209-b2aa-9b0e868b340c tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1313 microversion: 2.1 time: 0.789394 Aug 31 11:07:08.289678 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 104/205] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:07 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1313 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:08.312931 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2166a3fe-60b0-4360-9c1e-fe1efe1c8691 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "546a7f08-1bd1-4d9b-b7bc-95db1189f768"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:08.331317 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2166a3fe-60b0-4360-9c1e-fe1efe1c8691 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:08.357740 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2166a3fe-60b0-4360-9c1e-fe1efe1c8691 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:08.358404 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2166a3fe-60b0-4360-9c1e-fe1efe1c8691 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:08.359017 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2166a3fe-60b0-4360-9c1e-fe1efe1c8691 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:08.361000 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2166a3fe-60b0-4360-9c1e-fe1efe1c8691 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:08.361759 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2166a3fe-60b0-4360-9c1e-fe1efe1c8691 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:08.362330 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2166a3fe-60b0-4360-9c1e-fe1efe1c8691 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:08.557686 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a7256a5d-6c5d-41a7-851a-f9828ad370f2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:08.572248 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a7256a5d-6c5d-41a7-851a-f9828ad370f2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 1.276039 Aug 31 11:07:08.574924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 102/206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:07 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:08.999990 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:09.060303 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=6 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:09.142535 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-02c45a0b-438c-4b22-a34d-484e67b28d26 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Action: 'create', calling method: .version_select at 0x7f732d57a430>, body: {"keypair": {"name": "tempest-keypair-1600609806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4QfcChO8JIQEtIi3r1l16oOUg/puPsPhzSb2WyvCDDOtjqytebzzmDDWJNs1O8q0R/biElZrP9WgTK8R3LpiQDHBbxqEY78hJtcrJM0GNsOVN7KazvucgSi0jSXyNExA=="}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:09.165085 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-02c45a0b-438c-4b22-a34d-484e67b28d26 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Getting quotas for project 00b397afc10243bc9b93548873add6ef. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:07:09.168148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2166a3fe-60b0-4360-9c1e-fe1efe1c8691 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857814 Aug 31 11:07:09.169619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 105/207] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:07:08 2022] POST /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:09.182506 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-02c45a0b-438c-4b22-a34d-484e67b28d26 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Getting quotas for user 81d937b8a6c842819458b6e3c23f80fa and project 00b397afc10243bc9b93548873add6ef. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:07:09.239441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-02c45a0b-438c-4b22-a34d-484e67b28d26 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.661120 Aug 31 11:07:09.240363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 103/208] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 11:07:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:09.316886 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f6996266-6055-4450-8da5-8c211d3dffc0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:09.318277 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f6996266-6055-4450-8da5-8c211d3dffc0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:09.358263 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f6996266-6055-4450-8da5-8c211d3dffc0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:09.361192 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f6996266-6055-4450-8da5-8c211d3dffc0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:09.364948 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f6996266-6055-4450-8da5-8c211d3dffc0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:09.366141 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f6996266-6055-4450-8da5-8c211d3dffc0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:09.369836 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f6996266-6055-4450-8da5-8c211d3dffc0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:09.372755 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f6996266-6055-4450-8da5-8c211d3dffc0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:09.607180 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5857c637-67db-4de1-9f23-1b0ed0766c64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:09.607885 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-5857c637-67db-4de1-9f23-1b0ed0766c64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:09.632534 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5857c637-67db-4de1-9f23-1b0ed0766c64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:09.633381 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5857c637-67db-4de1-9f23-1b0ed0766c64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:09.634547 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5857c637-67db-4de1-9f23-1b0ed0766c64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:09.636085 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5857c637-67db-4de1-9f23-1b0ed0766c64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:09.644918 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5857c637-67db-4de1-9f23-1b0ed0766c64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:09.649253 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5857c637-67db-4de1-9f23-1b0ed0766c64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:09.733914 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f6996266-6055-4450-8da5-8c211d3dffc0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:09.746731 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f6996266-6055-4450-8da5-8c211d3dffc0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1313 microversion: 2.1 time: 0.435553 Aug 31 11:07:09.762304 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 106/209] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:09 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:10.157904 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5857c637-67db-4de1-9f23-1b0ed0766c64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:10.166733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-5857c637-67db-4de1-9f23-1b0ed0766c64 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.567257 Aug 31 11:07:10.167233 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 104/210] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:09 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:10.769686 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0405af75-de0e-4049-8b97-83f1d59b6d3b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:10.770441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-0405af75-de0e-4049-8b97-83f1d59b6d3b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:10.815904 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0405af75-de0e-4049-8b97-83f1d59b6d3b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:10.817739 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0405af75-de0e-4049-8b97-83f1d59b6d3b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:10.822415 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0405af75-de0e-4049-8b97-83f1d59b6d3b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:10.825534 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0405af75-de0e-4049-8b97-83f1d59b6d3b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:10.827717 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0405af75-de0e-4049-8b97-83f1d59b6d3b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:10.832281 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0405af75-de0e-4049-8b97-83f1d59b6d3b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:11.038418 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1454389522", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452"}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:11.204680 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.network.neutron [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] validate_networks() for None {{(pid=120655) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:07:11.215601 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0405af75-de0e-4049-8b97-83f1d59b6d3b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:11.228052 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0405af75-de0e-4049-8b97-83f1d59b6d3b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1313 microversion: 2.1 time: 0.462701 Aug 31 11:07:11.236485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 107/211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:10 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:11.259556 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7d671b0f-c210-457a-b2ca-5b113edfd2c6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:11.262277 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7d671b0f-c210-457a-b2ca-5b113edfd2c6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:11.278478 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d671b0f-c210-457a-b2ca-5b113edfd2c6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:11.282206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d671b0f-c210-457a-b2ca-5b113edfd2c6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:11.282937 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d671b0f-c210-457a-b2ca-5b113edfd2c6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:11.285220 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d671b0f-c210-457a-b2ca-5b113edfd2c6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:11.285936 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d671b0f-c210-457a-b2ca-5b113edfd2c6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:11.287671 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d671b0f-c210-457a-b2ca-5b113edfd2c6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:11.662706 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7d671b0f-c210-457a-b2ca-5b113edfd2c6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:11.677220 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7d671b0f-c210-457a-b2ca-5b113edfd2c6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.436173 Aug 31 11:07:11.680727 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 108/212] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:11 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:11.928898 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Flavor limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:07:11.930405 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Image limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:07:11.931580 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Flavor pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:07:11.932944 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Image pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:07:11.933572 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:07:11.965962 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:11.971323 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:11.971854 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:11.975091 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:11.975296 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:11.981750 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:12.009103 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Getting quotas for project 48c48ea6637c49d7b7cec6e805c4be87. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:07:12.021663 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Getting quotas for user ce412ceead11449aa5969320405e9f3a and project 48c48ea6637c49d7b7cec6e805c4be87. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:07:12.040665 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Going to run 1 instances... {{(pid=120655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:07:12.044610 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:07:12.115746 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-235dd311-bfb7-4ca5-8e5c-7c5e92290078 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.081911 Aug 31 11:07:12.127939 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-05b70ed7-b0c0-4341-bd2d-bf3184b6b955 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:12.130566 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-05b70ed7-b0c0-4341-bd2d-bf3184b6b955 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:12.140837 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 105/213] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:07:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:07:12.221236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-05b70ed7-b0c0-4341-bd2d-bf3184b6b955 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:12.232587 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-05b70ed7-b0c0-4341-bd2d-bf3184b6b955 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1215 microversion: 2.1 time: 0.108426 Aug 31 11:07:12.249399 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 109/214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:12 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:12.260556 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-700a0518-95c9-44aa-8821-0c6c1f2c0a08 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:12.260556 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-700a0518-95c9-44aa-8821-0c6c1f2c0a08 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:12.280929 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-700a0518-95c9-44aa-8821-0c6c1f2c0a08 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:12.283249 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-700a0518-95c9-44aa-8821-0c6c1f2c0a08 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:12.283965 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-700a0518-95c9-44aa-8821-0c6c1f2c0a08 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:12.290550 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-700a0518-95c9-44aa-8821-0c6c1f2c0a08 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:12.293653 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-700a0518-95c9-44aa-8821-0c6c1f2c0a08 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:12.294429 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-700a0518-95c9-44aa-8821-0c6c1f2c0a08 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:12.704463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a0ca3f85-7ff2-493e-a122-638ac56be4bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:12.705859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a0ca3f85-7ff2-493e-a122-638ac56be4bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:12.729660 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a0ca3f85-7ff2-493e-a122-638ac56be4bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:12.730824 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a0ca3f85-7ff2-493e-a122-638ac56be4bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:12.731533 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a0ca3f85-7ff2-493e-a122-638ac56be4bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:12.732797 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a0ca3f85-7ff2-493e-a122-638ac56be4bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:12.733488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a0ca3f85-7ff2-493e-a122-638ac56be4bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:12.734148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a0ca3f85-7ff2-493e-a122-638ac56be4bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:12.938662 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-700a0518-95c9-44aa-8821-0c6c1f2c0a08 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:12.952373 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-700a0518-95c9-44aa-8821-0c6c1f2c0a08 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1313 microversion: 2.1 time: 0.696800 Aug 31 11:07:12.954770 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 106/215] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:12 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1313 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:13.071918 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a0ca3f85-7ff2-493e-a122-638ac56be4bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:13.085853 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a0ca3f85-7ff2-493e-a122-638ac56be4bc tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.386117 Aug 31 11:07:13.091442 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 110/216] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:12 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:13.257332 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b7926f35-8279-4a65-9fef-9da522967ae8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:13.257883 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b7926f35-8279-4a65-9fef-9da522967ae8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:13.275376 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b7926f35-8279-4a65-9fef-9da522967ae8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:13.276616 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b7926f35-8279-4a65-9fef-9da522967ae8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:13.277059 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b7926f35-8279-4a65-9fef-9da522967ae8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:13.277761 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b7926f35-8279-4a65-9fef-9da522967ae8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:13.278213 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b7926f35-8279-4a65-9fef-9da522967ae8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:13.278633 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b7926f35-8279-4a65-9fef-9da522967ae8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:13.425117 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1236355636", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23e68a2b-4538-4158-bc21-13f4527b98dd"}], "security_groups": [{"name": "tempest-securitygroup--1637519882"}], "key_name": "tempest-keypair-1600609806", "user_data": "}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:13.563538 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b7926f35-8279-4a65-9fef-9da522967ae8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:13.578723 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b7926f35-8279-4a65-9fef-9da522967ae8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1219 microversion: 2.1 time: 0.327583 Aug 31 11:07:13.580445 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 107/217] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:13 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1219 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:13.600281 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-5cbb0c66-aa57-4150-b3d1-c259cadc3480 req-e5ab9fb3-bde9-484d-b4b3-75e738fe34a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c128235-7d40-4faf-a1ae-ee179935df87", "name": "network-vif-plugged", "status": "completed", "tag": "429c79d2-9753-444a-a907-6018680b4614"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:13.627323 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5cbb0c66-aa57-4150-b3d1-c259cadc3480 req-e5ab9fb3-bde9-484d-b4b3-75e738fe34a8 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:13.634186 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5cbb0c66-aa57-4150-b3d1-c259cadc3480 req-e5ab9fb3-bde9-484d-b4b3-75e738fe34a8 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:13.634938 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5cbb0c66-aa57-4150-b3d1-c259cadc3480 req-e5ab9fb3-bde9-484d-b4b3-75e738fe34a8 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:13.653934 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-5cbb0c66-aa57-4150-b3d1-c259cadc3480 req-e5ab9fb3-bde9-484d-b4b3-75e738fe34a8 service nova] Creating event network-vif-plugged:429c79d2-9753-444a-a907-6018680b4614 for instance 9c128235-7d40-4faf-a1ae-ee179935df87 on hv-cinder-85535 Aug 31 11:07:13.662653 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-5cbb0c66-aa57-4150-b3d1-c259cadc3480 req-e5ab9fb3-bde9-484d-b4b3-75e738fe34a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080780 Aug 31 11:07:13.663646 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 108/218] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:13.762959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] validate_networks() for [('23e68a2b-4538-4158-bc21-13f4527b98dd', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:07:13.987972 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7db2bdc8-c363-467d-bff8-3aaa98400781 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:13.989188 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-7db2bdc8-c363-467d-bff8-3aaa98400781 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:13.999467 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7db2bdc8-c363-467d-bff8-3aaa98400781 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:14.000636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7db2bdc8-c363-467d-bff8-3aaa98400781 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:14.001412 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7db2bdc8-c363-467d-bff8-3aaa98400781 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:14.002377 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7db2bdc8-c363-467d-bff8-3aaa98400781 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:14.003062 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7db2bdc8-c363-467d-bff8-3aaa98400781 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:14.005442 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7db2bdc8-c363-467d-bff8-3aaa98400781 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:14.376096 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7db2bdc8-c363-467d-bff8-3aaa98400781 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:14.389657 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7db2bdc8-c363-467d-bff8-3aaa98400781 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1313 microversion: 2.1 time: 0.416157 Aug 31 11:07:14.390271 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 109/219] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:13 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:07:14.407149 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8dc196c9-2fe4-445f-9c29-e236fdcf6dd2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:14.408103 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8dc196c9-2fe4-445f-9c29-e236fdcf6dd2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:14.417726 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dc196c9-2fe4-445f-9c29-e236fdcf6dd2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:14.418516 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dc196c9-2fe4-445f-9c29-e236fdcf6dd2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:14.419428 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dc196c9-2fe4-445f-9c29-e236fdcf6dd2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:14.420397 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dc196c9-2fe4-445f-9c29-e236fdcf6dd2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:14.421042 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dc196c9-2fe4-445f-9c29-e236fdcf6dd2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:14.421907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dc196c9-2fe4-445f-9c29-e236fdcf6dd2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:14.588073 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8dc196c9-2fe4-445f-9c29-e236fdcf6dd2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:14.600257 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8dc196c9-2fe4-445f-9c29-e236fdcf6dd2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.208613 Aug 31 11:07:14.615521 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 110/220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:14 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:14.629607 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8c698345-a9e2-488e-a5ca-a1a1ac91470b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:14.630766 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8c698345-a9e2-488e-a5ca-a1a1ac91470b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:14.637469 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8c698345-a9e2-488e-a5ca-a1a1ac91470b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:14.638091 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8c698345-a9e2-488e-a5ca-a1a1ac91470b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:14.638625 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8c698345-a9e2-488e-a5ca-a1a1ac91470b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:14.639426 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8c698345-a9e2-488e-a5ca-a1a1ac91470b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:14.639944 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8c698345-a9e2-488e-a5ca-a1a1ac91470b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:14.640490 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8c698345-a9e2-488e-a5ca-a1a1ac91470b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:14.776509 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8c698345-a9e2-488e-a5ca-a1a1ac91470b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:14.803120 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8c698345-a9e2-488e-a5ca-a1a1ac91470b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1267 microversion: 2.1 time: 0.187626 Aug 31 11:07:14.815516 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 111/221] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:14 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:14.945747 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:07:14.946459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:07:14.946729 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:07:14.946985 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:07:14.949468 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:07:14.961001 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:14.961850 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:14.962517 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:14.964679 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:14.965544 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:14.966218 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:14.976939 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:14.991589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Getting quotas for project 00b397afc10243bc9b93548873add6ef. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:07:14.998219 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Getting quotas for user 81d937b8a6c842819458b6e3c23f80fa and project 00b397afc10243bc9b93548873add6ef. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:07:15.000274 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8e95a7e2-24f2-482c-bcd5-2070ba6b4a4c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:15.000970 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8e95a7e2-24f2-482c-bcd5-2070ba6b4a4c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:15.009111 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8e95a7e2-24f2-482c-bcd5-2070ba6b4a4c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:15.010010 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8e95a7e2-24f2-482c-bcd5-2070ba6b4a4c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:15.010795 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8e95a7e2-24f2-482c-bcd5-2070ba6b4a4c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:15.011988 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8e95a7e2-24f2-482c-bcd5-2070ba6b4a4c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:15.012715 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8e95a7e2-24f2-482c-bcd5-2070ba6b4a4c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:15.013361 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8e95a7e2-24f2-482c-bcd5-2070ba6b4a4c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:15.017886 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:07:15.024933 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:07:15.042258 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8e95a7e2-24f2-482c-bcd5-2070ba6b4a4c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/ips" status: 200 len: 152 microversion: 2.20 time: 0.045283 Aug 31 11:07:15.043657 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 112/222] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Aug 31 11:07:14 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:07:15.154231 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f7900536-81ff-40a9-8b5c-8cffd6a98b29 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.742332 Aug 31 11:07:15.154880 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 111/223] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:07:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:07:15.165962 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4fb05f1a-b68d-49f1-a5a4-2a9dc7de5b6b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:15.176402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-4fb05f1a-b68d-49f1-a5a4-2a9dc7de5b6b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:15.379507 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4fb05f1a-b68d-49f1-a5a4-2a9dc7de5b6b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:15.387796 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4fb05f1a-b68d-49f1-a5a4-2a9dc7de5b6b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1238 microversion: 2.1 time: 0.225770 Aug 31 11:07:15.391406 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 113/224] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:15 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1238 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:15.413921 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2fdd3351-3b5f-4275-9550-164424f1667a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:15.414629 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2fdd3351-3b5f-4275-9550-164424f1667a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:15.461820 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2fdd3351-3b5f-4275-9550-164424f1667a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:15.463406 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2fdd3351-3b5f-4275-9550-164424f1667a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:15.464417 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2fdd3351-3b5f-4275-9550-164424f1667a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:15.465735 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2fdd3351-3b5f-4275-9550-164424f1667a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:15.467759 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2fdd3351-3b5f-4275-9550-164424f1667a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:15.468487 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2fdd3351-3b5f-4275-9550-164424f1667a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:15.657305 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0d5887af-da8c-4f5c-bff1-6bfd1c0cab79 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:15.659902 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0d5887af-da8c-4f5c-bff1-6bfd1c0cab79 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:15.690043 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d5887af-da8c-4f5c-bff1-6bfd1c0cab79 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:15.692596 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d5887af-da8c-4f5c-bff1-6bfd1c0cab79 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:15.693762 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d5887af-da8c-4f5c-bff1-6bfd1c0cab79 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:15.700094 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d5887af-da8c-4f5c-bff1-6bfd1c0cab79 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:15.702979 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d5887af-da8c-4f5c-bff1-6bfd1c0cab79 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:15.708782 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d5887af-da8c-4f5c-bff1-6bfd1c0cab79 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:16.162595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2fdd3351-3b5f-4275-9550-164424f1667a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:16.176784 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2fdd3351-3b5f-4275-9550-164424f1667a tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1313 microversion: 2.1 time: 0.767158 Aug 31 11:07:16.197898 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 112/225] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:15 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1313 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:16.197898 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-45d3a8c8-0ab1-4de6-a421-74ba9fb79f1d tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:16.197898 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-45d3a8c8-0ab1-4de6-a421-74ba9fb79f1d tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:16.217769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45d3a8c8-0ab1-4de6-a421-74ba9fb79f1d tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:16.220768 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45d3a8c8-0ab1-4de6-a421-74ba9fb79f1d tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:16.224155 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45d3a8c8-0ab1-4de6-a421-74ba9fb79f1d tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:16.225136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45d3a8c8-0ab1-4de6-a421-74ba9fb79f1d tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:16.226915 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45d3a8c8-0ab1-4de6-a421-74ba9fb79f1d tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:16.228886 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45d3a8c8-0ab1-4de6-a421-74ba9fb79f1d tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:16.591083 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0d5887af-da8c-4f5c-bff1-6bfd1c0cab79 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:16.606172 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0d5887af-da8c-4f5c-bff1-6bfd1c0cab79 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.985193 Aug 31 11:07:16.620926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 114/226] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:15 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:16.626689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-292820a1-9a00-4722-89ba-bb3165278c4b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:16.627755 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-292820a1-9a00-4722-89ba-bb3165278c4b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:16.636456 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-292820a1-9a00-4722-89ba-bb3165278c4b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:16.637923 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-292820a1-9a00-4722-89ba-bb3165278c4b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:16.638655 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-292820a1-9a00-4722-89ba-bb3165278c4b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:16.639719 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-292820a1-9a00-4722-89ba-bb3165278c4b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:16.640899 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-292820a1-9a00-4722-89ba-bb3165278c4b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:16.641654 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-292820a1-9a00-4722-89ba-bb3165278c4b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:16.660039 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-45d3a8c8-0ab1-4de6-a421-74ba9fb79f1d tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:16.682571 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-45d3a8c8-0ab1-4de6-a421-74ba9fb79f1d tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1273 microversion: 2.1 time: 0.495446 Aug 31 11:07:16.683564 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 113/227] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:16 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1273 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:16.846133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-292820a1-9a00-4722-89ba-bb3165278c4b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:16.875953 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-292820a1-9a00-4722-89ba-bb3165278c4b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1242 microversion: 2.1 time: 0.250201 Aug 31 11:07:16.877214 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 115/228] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:16 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1242 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:17.219165 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-01a199fb-ff4a-4b5e-af9c-471dac0bf24b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:17.220434 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-01a199fb-ff4a-4b5e-af9c-471dac0bf24b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:17.235680 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-01a199fb-ff4a-4b5e-af9c-471dac0bf24b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:17.236498 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-01a199fb-ff4a-4b5e-af9c-471dac0bf24b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:17.237192 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-01a199fb-ff4a-4b5e-af9c-471dac0bf24b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:17.238360 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-01a199fb-ff4a-4b5e-af9c-471dac0bf24b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:17.239119 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-01a199fb-ff4a-4b5e-af9c-471dac0bf24b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:17.239833 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-01a199fb-ff4a-4b5e-af9c-471dac0bf24b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:17.329328 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-df91b88a-9bb7-4c54-99b2-47167bd2990d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: .version_select at 0x7f732d57a430>, body: {"keypair": {"name": "tempest-keypair-1193661226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXI/ltwZpBxpSb0dMAcHJu3zjE58qtFpoNC+XrT1x0yDbzbrN1PebBKL/kkMYQkEcbdP1Wu4lIu0GN1R5tLa2UFS4KiVVIg3FeLwOiquKXExnhn2/CX8vZKQEBBr3jXnQ=="}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:17.375503 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-df91b88a-9bb7-4c54-99b2-47167bd2990d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:07:17.395670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-df91b88a-9bb7-4c54-99b2-47167bd2990d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for user d0e5dae087184c56b1cb72fb7705d4d5 and project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:07:17.447161 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-df91b88a-9bb7-4c54-99b2-47167bd2990d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120794 Aug 31 11:07:17.448566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 116/229] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 11:07:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:07:17.487549 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-16da2dab-23ae-443a-8660-152b3c62d177 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:17.488479 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-16da2dab-23ae-443a-8660-152b3c62d177 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:17.503706 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-16da2dab-23ae-443a-8660-152b3c62d177 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:17.504525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-16da2dab-23ae-443a-8660-152b3c62d177 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:17.505113 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-16da2dab-23ae-443a-8660-152b3c62d177 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:17.505982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-16da2dab-23ae-443a-8660-152b3c62d177 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:17.508404 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-16da2dab-23ae-443a-8660-152b3c62d177 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:17.509020 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-16da2dab-23ae-443a-8660-152b3c62d177 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:17.592613 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-16da2dab-23ae-443a-8660-152b3c62d177 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lazy-loading 'flavor' on Instance uuid 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:07:17.952726 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-01a199fb-ff4a-4b5e-af9c-471dac0bf24b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:17.977290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-01a199fb-ff4a-4b5e-af9c-471dac0bf24b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1497 microversion: 2.1 time: 0.769150 Aug 31 11:07:17.990457 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 114/230] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:17 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1497 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:18.051231 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-86a86d49-c650-47f4-8480-b310f337f7b9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:18.053643 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-86a86d49-c650-47f4-8480-b310f337f7b9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:18.098911 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-16da2dab-23ae-443a-8660-152b3c62d177 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "POST /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/action" status: 202 len: 0 microversion: 2.20 time: 0.631529 Aug 31 11:07:18.100230 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 117/231] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 31 11:07:17 2022] POST /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/action => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:07:18.114003 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-13d3288f-8a40-44ac-a8aa-2c117cd1442e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:18.117882 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-13d3288f-8a40-44ac-a8aa-2c117cd1442e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:18.123081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-86a86d49-c650-47f4-8480-b310f337f7b9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:18.135661 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-86a86d49-c650-47f4-8480-b310f337f7b9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:18.137593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:18.138810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-86a86d49-c650-47f4-8480-b310f337f7b9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:18.142297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-86a86d49-c650-47f4-8480-b310f337f7b9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:18.143011 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-86a86d49-c650-47f4-8480-b310f337f7b9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:18.144430 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-86a86d49-c650-47f4-8480-b310f337f7b9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:18.151262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-13d3288f-8a40-44ac-a8aa-2c117cd1442e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:18.152107 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-13d3288f-8a40-44ac-a8aa-2c117cd1442e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:18.162685 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-13d3288f-8a40-44ac-a8aa-2c117cd1442e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:18.169333 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-13d3288f-8a40-44ac-a8aa-2c117cd1442e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:18.173270 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-13d3288f-8a40-44ac-a8aa-2c117cd1442e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:18.173826 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-13d3288f-8a40-44ac-a8aa-2c117cd1442e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:18.422439 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-13d3288f-8a40-44ac-a8aa-2c117cd1442e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:18.444636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-13d3288f-8a40-44ac-a8aa-2c117cd1442e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1273 microversion: 2.1 time: 0.336773 Aug 31 11:07:18.461453 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 118/232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:18 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1273 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:18.473244 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5251ea79-bb1f-43f9-822a-9304c89527e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:18.473887 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-5251ea79-bb1f-43f9-822a-9304c89527e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:18.506468 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5251ea79-bb1f-43f9-822a-9304c89527e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:18.506896 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5251ea79-bb1f-43f9-822a-9304c89527e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:18.507344 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5251ea79-bb1f-43f9-822a-9304c89527e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:18.514305 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5251ea79-bb1f-43f9-822a-9304c89527e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:18.514879 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5251ea79-bb1f-43f9-822a-9304c89527e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:18.515933 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5251ea79-bb1f-43f9-822a-9304c89527e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:18.679940 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5251ea79-bb1f-43f9-822a-9304c89527e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:18.682336 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:18.702767 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-5251ea79-bb1f-43f9-822a-9304c89527e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1298 microversion: 2.1 time: 0.239992 Aug 31 11:07:18.703632 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 119/233] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:18 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1298 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:18.719285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f2677342-007a-4efb-829d-be65c273be7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:18.720515 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-f2677342-007a-4efb-829d-be65c273be7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:18.738927 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f2677342-007a-4efb-829d-be65c273be7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:18.739975 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f2677342-007a-4efb-829d-be65c273be7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:18.741509 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f2677342-007a-4efb-829d-be65c273be7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:18.742830 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f2677342-007a-4efb-829d-be65c273be7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:18.743651 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f2677342-007a-4efb-829d-be65c273be7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:18.744479 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f2677342-007a-4efb-829d-be65c273be7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:19.177819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-86a86d49-c650-47f4-8480-b310f337f7b9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:19.196817 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-86a86d49-c650-47f4-8480-b310f337f7b9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 1.204751 Aug 31 11:07:19.210983 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 115/234] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:17 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:19.222184 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4ee1de76-0108-4feb-ba30-489739f17de2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:19.222472 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4ee1de76-0108-4feb-ba30-489739f17de2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:19.230242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ee1de76-0108-4feb-ba30-489739f17de2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:19.230938 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ee1de76-0108-4feb-ba30-489739f17de2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:19.238877 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ee1de76-0108-4feb-ba30-489739f17de2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:19.240659 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ee1de76-0108-4feb-ba30-489739f17de2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:19.241356 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ee1de76-0108-4feb-ba30-489739f17de2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:19.242110 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ee1de76-0108-4feb-ba30-489739f17de2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:19.289980 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4ee1de76-0108-4feb-ba30-489739f17de2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:07:19.411972 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4ee1de76-0108-4feb-ba30-489739f17de2 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 204 len: 0 microversion: 2.1 time: 0.197920 Aug 31 11:07:19.418243 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 116/235] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:07:19 2022] DELETE /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:07:19.426158 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-41b4f55e-beaf-4542-9b30-2cb981cfbf9b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:19.427198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-41b4f55e-beaf-4542-9b30-2cb981cfbf9b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:19.434365 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-41b4f55e-beaf-4542-9b30-2cb981cfbf9b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:19.435117 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-41b4f55e-beaf-4542-9b30-2cb981cfbf9b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:19.435723 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-41b4f55e-beaf-4542-9b30-2cb981cfbf9b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:19.436664 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-41b4f55e-beaf-4542-9b30-2cb981cfbf9b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:19.437285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-41b4f55e-beaf-4542-9b30-2cb981cfbf9b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:19.437859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-41b4f55e-beaf-4542-9b30-2cb981cfbf9b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:19.532354 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-f2677342-007a-4efb-829d-be65c273be7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:19.551171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-f2677342-007a-4efb-829d-be65c273be7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:19.566223 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-f2677342-007a-4efb-829d-be65c273be7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:19.568219 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-f2677342-007a-4efb-829d-be65c273be7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1725 microversion: 2.20 time: 0.862947 Aug 31 11:07:19.569380 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 120/236] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:18 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1725 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:19.577225 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-86d6e407-f480-47f5-b74f-e6d8e6fabaf1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:19.578336 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-86d6e407-f480-47f5-b74f-e6d8e6fabaf1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:19.585563 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86d6e407-f480-47f5-b74f-e6d8e6fabaf1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:19.587307 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86d6e407-f480-47f5-b74f-e6d8e6fabaf1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:19.589040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86d6e407-f480-47f5-b74f-e6d8e6fabaf1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:19.590086 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86d6e407-f480-47f5-b74f-e6d8e6fabaf1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:19.590700 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86d6e407-f480-47f5-b74f-e6d8e6fabaf1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:19.591811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86d6e407-f480-47f5-b74f-e6d8e6fabaf1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:19.901663 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-86d6e407-f480-47f5-b74f-e6d8e6fabaf1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:19.904999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-41b4f55e-beaf-4542-9b30-2cb981cfbf9b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:19.911667 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-86d6e407-f480-47f5-b74f-e6d8e6fabaf1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1315 microversion: 2.1 time: 0.341074 Aug 31 11:07:19.912280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 121/237] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:19 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:19.922881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4b1152a5-70c0-4120-8672-7ac0bf6e4094 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:19.923728 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-4b1152a5-70c0-4120-8672-7ac0bf6e4094 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:19.935888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-41b4f55e-beaf-4542-9b30-2cb981cfbf9b tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1503 microversion: 2.1 time: 0.514758 Aug 31 11:07:19.948722 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 117/238] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:19 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1503 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:19.952679 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4b1152a5-70c0-4120-8672-7ac0bf6e4094 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:19.953419 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4b1152a5-70c0-4120-8672-7ac0bf6e4094 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:19.954045 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4b1152a5-70c0-4120-8672-7ac0bf6e4094 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:19.954763 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4b1152a5-70c0-4120-8672-7ac0bf6e4094 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:19.955218 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4b1152a5-70c0-4120-8672-7ac0bf6e4094 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:19.955647 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4b1152a5-70c0-4120-8672-7ac0bf6e4094 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:20.085820 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4b1152a5-70c0-4120-8672-7ac0bf6e4094 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:20.104627 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4b1152a5-70c0-4120-8672-7ac0bf6e4094 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1296 microversion: 2.1 time: 0.180456 Aug 31 11:07:20.108779 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 122/239] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:19 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1296 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:20.237265 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6344b39c-8e52-48b6-92ea-0f75dbce09ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:20.238571 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6344b39c-8e52-48b6-92ea-0f75dbce09ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:20.252931 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6344b39c-8e52-48b6-92ea-0f75dbce09ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:20.255853 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6344b39c-8e52-48b6-92ea-0f75dbce09ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:20.265321 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6344b39c-8e52-48b6-92ea-0f75dbce09ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:20.268370 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6344b39c-8e52-48b6-92ea-0f75dbce09ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:20.271234 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6344b39c-8e52-48b6-92ea-0f75dbce09ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:20.272444 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6344b39c-8e52-48b6-92ea-0f75dbce09ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:20.488616 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-2afff452-e20c-49ef-9894-3a6a4bdbcb08 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Action: 'create', calling method: .version_select at 0x7f732d57a0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-400811564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMulba8VWPS4suVgu13BL9FA9bQwDTSMrh/K9g8f/00wUy2qB3VMigmmbknyf2zCVHxSnAguVMs30GgDnUKz20wzxElSgABh/n/FchtojCTYKBWCcDNkjx4J0xXyCOjnA=="}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:20.505089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=19 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:20.508282 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-2afff452-e20c-49ef-9894-3a6a4bdbcb08 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Getting quotas for project 6e4af9139d2b47cf8ea8646c5a4f4a9f. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:07:20.514036 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-2afff452-e20c-49ef-9894-3a6a4bdbcb08 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Getting quotas for user 74fa7242b82941cc9ef9f21f122b1e4c and project 6e4af9139d2b47cf8ea8646c5a4f4a9f. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:07:20.547177 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-2afff452-e20c-49ef-9894-3a6a4bdbcb08 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062572 Aug 31 11:07:20.560825 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 123/240] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 11:07:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:20.602500 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b7c5aba5-1694-4aab-a005-6b183ba74fe2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:20.603165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b7c5aba5-1694-4aab-a005-6b183ba74fe2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:20.617306 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b7c5aba5-1694-4aab-a005-6b183ba74fe2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:20.618336 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b7c5aba5-1694-4aab-a005-6b183ba74fe2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:20.618789 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b7c5aba5-1694-4aab-a005-6b183ba74fe2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:20.621351 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b7c5aba5-1694-4aab-a005-6b183ba74fe2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:20.622184 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b7c5aba5-1694-4aab-a005-6b183ba74fe2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:20.622943 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b7c5aba5-1694-4aab-a005-6b183ba74fe2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:20.763276 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6344b39c-8e52-48b6-92ea-0f75dbce09ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:20.772913 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6344b39c-8e52-48b6-92ea-0f75dbce09ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.540364 Aug 31 11:07:20.773862 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 118/241] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:20 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:20.779459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1051756490", "imageRef": "62727e63-a878-4526-a05d-6dd3a181c80e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-400811564", "networks": [{"uuid": "757e0a3b-3a72-48b5-8d5c-7734410a49dc"}]}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:20.858022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] validate_networks() for [('757e0a3b-3a72-48b5-8d5c-7734410a49dc', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:07:21.108267 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b7c5aba5-1694-4aab-a005-6b183ba74fe2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:21.126091 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b7c5aba5-1694-4aab-a005-6b183ba74fe2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:21.128200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b7c5aba5-1694-4aab-a005-6b183ba74fe2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:21.133047 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b7c5aba5-1694-4aab-a005-6b183ba74fe2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1725 microversion: 2.20 time: 0.540605 Aug 31 11:07:21.169200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 124/242] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:20 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1725 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:07:21.206619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d742ce70-e327-4f68-9b34-2b488f7c9832 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:21.208301 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d742ce70-e327-4f68-9b34-2b488f7c9832 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:21.239843 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d742ce70-e327-4f68-9b34-2b488f7c9832 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:21.240748 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d742ce70-e327-4f68-9b34-2b488f7c9832 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:21.241766 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d742ce70-e327-4f68-9b34-2b488f7c9832 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:21.243424 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d742ce70-e327-4f68-9b34-2b488f7c9832 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:21.245619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d742ce70-e327-4f68-9b34-2b488f7c9832 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:21.246507 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d742ce70-e327-4f68-9b34-2b488f7c9832 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:21.731897 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:07:21.732487 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:07:21.732912 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:07:21.733221 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:07:21.733797 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:07:21.744545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:21.745084 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:21.745528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:21.746286 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:21.746749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:21.747204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:21.772854 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Getting quotas for project 6e4af9139d2b47cf8ea8646c5a4f4a9f. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:07:21.779531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Getting quotas for user 74fa7242b82941cc9ef9f21f122b1e4c and project 6e4af9139d2b47cf8ea8646c5a4f4a9f. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:07:21.801929 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:07:21.805333 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62727e63-a878-4526-a05d-6dd3a181c80e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:07:21.882178 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-5b1bf375-a342-4779-bed7-2d91043f71e2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106854 Aug 31 11:07:21.886207 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 119/243] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:07:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:07:21.911652 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5484a528-d8f0-4876-9d97-857a8d0c5159 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:21.912317 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5484a528-d8f0-4876-9d97-857a8d0c5159 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:21.926411 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:21.930000 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5484a528-d8f0-4876-9d97-857a8d0c5159 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:21.930664 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5484a528-d8f0-4876-9d97-857a8d0c5159 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:21.931102 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5484a528-d8f0-4876-9d97-857a8d0c5159 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:21.932336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5484a528-d8f0-4876-9d97-857a8d0c5159 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:21.932919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5484a528-d8f0-4876-9d97-857a8d0c5159 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:21.933346 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5484a528-d8f0-4876-9d97-857a8d0c5159 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:22.000162 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:22.148686 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-5484a528-d8f0-4876-9d97-857a8d0c5159 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:22.162454 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-5484a528-d8f0-4876-9d97-857a8d0c5159 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1503 microversion: 2.1 time: 0.272092 Aug 31 11:07:22.163399 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 120/244] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:21 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:22.196459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-86643e53-aa19-4a93-83ba-f8fcb9c9c225 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:22.197085 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-86643e53-aa19-4a93-83ba-f8fcb9c9c225 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:22.207668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-86643e53-aa19-4a93-83ba-f8fcb9c9c225 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:22.208179 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-86643e53-aa19-4a93-83ba-f8fcb9c9c225 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:22.208624 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-86643e53-aa19-4a93-83ba-f8fcb9c9c225 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:22.209347 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-86643e53-aa19-4a93-83ba-f8fcb9c9c225 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:22.209883 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-86643e53-aa19-4a93-83ba-f8fcb9c9c225 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:22.210300 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-86643e53-aa19-4a93-83ba-f8fcb9c9c225 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:22.505702 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d742ce70-e327-4f68-9b34-2b488f7c9832 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:22.517948 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d742ce70-e327-4f68-9b34-2b488f7c9832 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1315 microversion: 2.1 time: 1.347374 Aug 31 11:07:22.525252 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 125/245] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:21 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1315 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:22.538798 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9ac415f4-4718-4c70-8bec-68a4186bc179 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:22.539774 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-9ac415f4-4718-4c70-8bec-68a4186bc179 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:22.547808 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9ac415f4-4718-4c70-8bec-68a4186bc179 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:22.548725 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9ac415f4-4718-4c70-8bec-68a4186bc179 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:22.549500 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9ac415f4-4718-4c70-8bec-68a4186bc179 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:22.550439 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9ac415f4-4718-4c70-8bec-68a4186bc179 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:22.551125 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9ac415f4-4718-4c70-8bec-68a4186bc179 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:22.551757 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9ac415f4-4718-4c70-8bec-68a4186bc179 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:22.886039 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-86643e53-aa19-4a93-83ba-f8fcb9c9c225 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:22.899032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-86643e53-aa19-4a93-83ba-f8fcb9c9c225 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1364 microversion: 2.1 time: 0.703952 Aug 31 11:07:22.899709 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 121/246] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:22 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1364 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:22.907134 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a3c94c28-63d0-4c68-8072-c72fa1169820 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:22.913151 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a3c94c28-63d0-4c68-8072-c72fa1169820 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:22.928926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a3c94c28-63d0-4c68-8072-c72fa1169820 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:22.929825 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a3c94c28-63d0-4c68-8072-c72fa1169820 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:22.930497 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a3c94c28-63d0-4c68-8072-c72fa1169820 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:22.932049 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a3c94c28-63d0-4c68-8072-c72fa1169820 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:22.932804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a3c94c28-63d0-4c68-8072-c72fa1169820 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:22.934007 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a3c94c28-63d0-4c68-8072-c72fa1169820 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:23.091526 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a3c94c28-63d0-4c68-8072-c72fa1169820 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:23.107492 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a3c94c28-63d0-4c68-8072-c72fa1169820 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1310 microversion: 2.1 time: 0.205885 Aug 31 11:07:23.139437 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 122/247] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:22 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1310 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:23.154938 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-973ac879-7350-4fd1-87c8-49b612979344 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:23.155826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-973ac879-7350-4fd1-87c8-49b612979344 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:23.183528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-973ac879-7350-4fd1-87c8-49b612979344 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:23.184373 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-973ac879-7350-4fd1-87c8-49b612979344 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:23.191528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-973ac879-7350-4fd1-87c8-49b612979344 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:23.193194 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-973ac879-7350-4fd1-87c8-49b612979344 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:23.195851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-973ac879-7350-4fd1-87c8-49b612979344 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:23.198877 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-973ac879-7350-4fd1-87c8-49b612979344 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:23.411617 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-9ac415f4-4718-4c70-8bec-68a4186bc179 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:23.434478 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-9ac415f4-4718-4c70-8bec-68a4186bc179 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.896804 Aug 31 11:07:23.438093 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 126/248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:22 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:23.451350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8dd9bf79-3f7b-4712-b35d-eb3b077bcba0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:23.451350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8dd9bf79-3f7b-4712-b35d-eb3b077bcba0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:23.463290 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dd9bf79-3f7b-4712-b35d-eb3b077bcba0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:23.463927 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dd9bf79-3f7b-4712-b35d-eb3b077bcba0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:23.464440 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dd9bf79-3f7b-4712-b35d-eb3b077bcba0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:23.465196 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dd9bf79-3f7b-4712-b35d-eb3b077bcba0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:23.465655 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dd9bf79-3f7b-4712-b35d-eb3b077bcba0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:23.472555 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dd9bf79-3f7b-4712-b35d-eb3b077bcba0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:23.528868 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-973ac879-7350-4fd1-87c8-49b612979344 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:23.539600 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-973ac879-7350-4fd1-87c8-49b612979344 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:23.541764 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-973ac879-7350-4fd1-87c8-49b612979344 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:23.542975 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-973ac879-7350-4fd1-87c8-49b612979344 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1725 microversion: 2.20 time: 0.402108 Aug 31 11:07:23.545306 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 123/249] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:23 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1725 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:23.550227 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-b712fa90-f153-472a-a2c3-bee598e19fc0 req-2e9a0f07-12f7-47ad-a79a-96e9d5ee6e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c128235-7d40-4faf-a1ae-ee179935df87", "name": "network-vif-deleted", "tag": "429c79d2-9753-444a-a907-6018680b4614"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:23.565125 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b712fa90-f153-472a-a2c3-bee598e19fc0 req-2e9a0f07-12f7-47ad-a79a-96e9d5ee6e33 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:23.565583 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b712fa90-f153-472a-a2c3-bee598e19fc0 req-2e9a0f07-12f7-47ad-a79a-96e9d5ee6e33 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:23.566134 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b712fa90-f153-472a-a2c3-bee598e19fc0 req-2e9a0f07-12f7-47ad-a79a-96e9d5ee6e33 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:23.578923 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-b712fa90-f153-472a-a2c3-bee598e19fc0 req-2e9a0f07-12f7-47ad-a79a-96e9d5ee6e33 service nova] Creating event network-vif-deleted:429c79d2-9753-444a-a907-6018680b4614 for instance 9c128235-7d40-4faf-a1ae-ee179935df87 on hv-cinder-85535 Aug 31 11:07:23.584956 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-b712fa90-f153-472a-a2c3-bee598e19fc0 req-2e9a0f07-12f7-47ad-a79a-96e9d5ee6e33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038166 Aug 31 11:07:23.585656 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 124/250] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:23.591712 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4041fc91-96d2-4fd5-9c8f-7d9a3ca019f7 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:23.592620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4041fc91-96d2-4fd5-9c8f-7d9a3ca019f7 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:23.600000 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4041fc91-96d2-4fd5-9c8f-7d9a3ca019f7 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:23.600520 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4041fc91-96d2-4fd5-9c8f-7d9a3ca019f7 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:23.601111 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4041fc91-96d2-4fd5-9c8f-7d9a3ca019f7 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:23.601979 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4041fc91-96d2-4fd5-9c8f-7d9a3ca019f7 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:23.602585 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4041fc91-96d2-4fd5-9c8f-7d9a3ca019f7 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:23.603799 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4041fc91-96d2-4fd5-9c8f-7d9a3ca019f7 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:23.829895 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8dd9bf79-3f7b-4712-b35d-eb3b077bcba0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:23.857190 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8dd9bf79-3f7b-4712-b35d-eb3b077bcba0 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1298 microversion: 2.1 time: 0.417058 Aug 31 11:07:23.875613 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 127/251] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:23 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1298 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:23.937396 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-2f864b30-0ba2-4bf6-8838-80053eecf97a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:23.937396 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-2f864b30-0ba2-4bf6-8838-80053eecf97a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:23.945925 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2f864b30-0ba2-4bf6-8838-80053eecf97a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:23.947267 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2f864b30-0ba2-4bf6-8838-80053eecf97a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:23.948122 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2f864b30-0ba2-4bf6-8838-80053eecf97a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:23.949368 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2f864b30-0ba2-4bf6-8838-80053eecf97a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:23.950173 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2f864b30-0ba2-4bf6-8838-80053eecf97a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:23.950918 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2f864b30-0ba2-4bf6-8838-80053eecf97a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:23.967210 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4041fc91-96d2-4fd5-9c8f-7d9a3ca019f7 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:23.976368 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4041fc91-96d2-4fd5-9c8f-7d9a3ca019f7 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1315 microversion: 2.1 time: 0.389454 Aug 31 11:07:23.977268 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 125/252] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:23 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:24.158478 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-825bc824-a779-4598-8b10-c5be890570f2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:24.166226 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-825bc824-a779-4598-8b10-c5be890570f2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:24.171126 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-825bc824-a779-4598-8b10-c5be890570f2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:24.171824 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-825bc824-a779-4598-8b10-c5be890570f2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:24.172464 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-825bc824-a779-4598-8b10-c5be890570f2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:24.173401 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-825bc824-a779-4598-8b10-c5be890570f2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:24.174135 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-825bc824-a779-4598-8b10-c5be890570f2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:24.174577 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-825bc824-a779-4598-8b10-c5be890570f2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:24.282729 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-825bc824-a779-4598-8b10-c5be890570f2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:24.297315 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-825bc824-a779-4598-8b10-c5be890570f2 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1318 microversion: 2.1 time: 0.143067 Aug 31 11:07:24.298306 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 126/253] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:24 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:07:24.463474 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-df632a33-cd60-4285-b1ce-ef8068387ed5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:24.464780 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-df632a33-cd60-4285-b1ce-ef8068387ed5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:24.477291 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-df632a33-cd60-4285-b1ce-ef8068387ed5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:24.478613 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-df632a33-cd60-4285-b1ce-ef8068387ed5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:24.479472 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-df632a33-cd60-4285-b1ce-ef8068387ed5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:24.480723 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-df632a33-cd60-4285-b1ce-ef8068387ed5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:24.481724 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-df632a33-cd60-4285-b1ce-ef8068387ed5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:24.482315 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-df632a33-cd60-4285-b1ce-ef8068387ed5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:24.484394 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-2f864b30-0ba2-4bf6-8838-80053eecf97a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:24.500661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-2f864b30-0ba2-4bf6-8838-80053eecf97a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1364 microversion: 2.1 time: 0.568581 Aug 31 11:07:24.525287 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 128/254] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:23 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1364 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:24.571474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-26d3dba3-cede-4dbc-8df7-508f252fa5d4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:24.572665 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-26d3dba3-cede-4dbc-8df7-508f252fa5d4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:24.582217 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-26d3dba3-cede-4dbc-8df7-508f252fa5d4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:24.583029 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-26d3dba3-cede-4dbc-8df7-508f252fa5d4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:24.583870 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-26d3dba3-cede-4dbc-8df7-508f252fa5d4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:24.585558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-26d3dba3-cede-4dbc-8df7-508f252fa5d4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:24.586248 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-26d3dba3-cede-4dbc-8df7-508f252fa5d4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:24.586830 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-26d3dba3-cede-4dbc-8df7-508f252fa5d4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:24.848589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-df632a33-cd60-4285-b1ce-ef8068387ed5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:24.861588 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-df632a33-cd60-4285-b1ce-ef8068387ed5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.405829 Aug 31 11:07:24.865575 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 127/255] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:24 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:24.874348 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-936516270", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6f1d69a-015b-48c6-bbc4-eabba1f958e8"}], "security_groups": [{"name": "tempest-securitygroup--1020236457"}], "key_name": "tempest-keypair-1193661226", "user_data": "}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:25.097374 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] validate_networks() for [('b6f1d69a-015b-48c6-bbc4-eabba1f958e8', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:07:25.259563 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-26d3dba3-cede-4dbc-8df7-508f252fa5d4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:25.280290 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-26d3dba3-cede-4dbc-8df7-508f252fa5d4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:25.283866 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-26d3dba3-cede-4dbc-8df7-508f252fa5d4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:25.289183 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-26d3dba3-cede-4dbc-8df7-508f252fa5d4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1725 microversion: 2.20 time: 0.722207 Aug 31 11:07:25.291052 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 129/256] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:24 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1725 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:07:25.299491 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:25.329128 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:25.357836 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:25.358528 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:25.358910 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:25.359902 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:25.363107 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:25.363729 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:25.445294 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:25.445701 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:25.450469 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:25.451037 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lazy-loading 'fault' on Instance uuid 9c128235-7d40-4faf-a1ae-ee179935df87 {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:07:25.641083 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe027aad062342688c587428f2bfbfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2365f1500c5405aab2ea6e892fbb832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:25.650903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8d0a93d0-4d67-4a83-95e5-f2f67741b24f tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 200 len: 1303 microversion: 2.1 time: 0.358095 Aug 31 11:07:25.655022 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 130/257] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:25 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 1303 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:25.667776 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c460fc0e-35d3-4d17-98d5-e5ac0cb70996 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:25.685764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c460fc0e-35d3-4d17-98d5-e5ac0cb70996 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:25.704132 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c460fc0e-35d3-4d17-98d5-e5ac0cb70996 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:25.705455 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c460fc0e-35d3-4d17-98d5-e5ac0cb70996 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:25.707128 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c460fc0e-35d3-4d17-98d5-e5ac0cb70996 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:25.709384 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c460fc0e-35d3-4d17-98d5-e5ac0cb70996 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:25.716104 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c460fc0e-35d3-4d17-98d5-e5ac0cb70996 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:25.716555 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c460fc0e-35d3-4d17-98d5-e5ac0cb70996 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:25.898386 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:07:25.898806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:07:25.899473 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:07:25.900312 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:07:25.900594 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:07:25.911978 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:25.912500 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:25.912930 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:25.913733 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:25.914346 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:25.914771 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:25.922197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:25.943604 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:07:25.949226 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for user d0e5dae087184c56b1cb72fb7705d4d5 and project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:07:25.962557 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:07:25.965117 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:07:26.030015 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6364d7eb-fea6-438d-83c1-b0cc28f88207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.161647 Aug 31 11:07:26.038123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 128/258] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:07:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:07:26.044436 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e24ec9aa-b35a-4ad2-9f15-b231cb8f728f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:26.045554 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e24ec9aa-b35a-4ad2-9f15-b231cb8f728f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:26.054010 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e24ec9aa-b35a-4ad2-9f15-b231cb8f728f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:26.054887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e24ec9aa-b35a-4ad2-9f15-b231cb8f728f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:26.055544 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e24ec9aa-b35a-4ad2-9f15-b231cb8f728f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:26.057100 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e24ec9aa-b35a-4ad2-9f15-b231cb8f728f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:26.057834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e24ec9aa-b35a-4ad2-9f15-b231cb8f728f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:26.060148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e24ec9aa-b35a-4ad2-9f15-b231cb8f728f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:26.183737 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e24ec9aa-b35a-4ad2-9f15-b231cb8f728f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:26.193954 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e24ec9aa-b35a-4ad2-9f15-b231cb8f728f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1316 microversion: 2.1 time: 0.152952 Aug 31 11:07:26.195766 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 129/259] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:26 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:26.207247 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2156cd81-0858-4904-8fe1-7c874c428692 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:26.207871 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2156cd81-0858-4904-8fe1-7c874c428692 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:26.225051 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2156cd81-0858-4904-8fe1-7c874c428692 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:26.227089 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2156cd81-0858-4904-8fe1-7c874c428692 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:26.230138 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2156cd81-0858-4904-8fe1-7c874c428692 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:26.232408 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2156cd81-0858-4904-8fe1-7c874c428692 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:26.233088 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2156cd81-0858-4904-8fe1-7c874c428692 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:26.234247 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2156cd81-0858-4904-8fe1-7c874c428692 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:26.522049 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2156cd81-0858-4904-8fe1-7c874c428692 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:26.533638 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2156cd81-0858-4904-8fe1-7c874c428692 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1364 microversion: 2.1 time: 0.335111 Aug 31 11:07:26.534983 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 130/260] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:26 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1364 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:26.557077 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-fe824765-1b53-4a8f-8a90-076f8df8832c req-ea354a18-7c1c-4aa9-9023-3fabdc8f9661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd", "tag": "9b78d397-c172-459c-b216-ef5a6b700eb2"}, {"name": "network-changed", "server_uuid": "b50ff8cd-8095-43f9-9b25-30536f129ac3", "tag": "21aa5d3b-5335-4948-b4c1-66ad46c33844"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:26.582715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-fe824765-1b53-4a8f-8a90-076f8df8832c req-ea354a18-7c1c-4aa9-9023-3fabdc8f9661 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:26.586041 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-fe824765-1b53-4a8f-8a90-076f8df8832c req-ea354a18-7c1c-4aa9-9023-3fabdc8f9661 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:26.586771 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-fe824765-1b53-4a8f-8a90-076f8df8832c req-ea354a18-7c1c-4aa9-9023-3fabdc8f9661 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:26.626858 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-fe824765-1b53-4a8f-8a90-076f8df8832c req-ea354a18-7c1c-4aa9-9023-3fabdc8f9661 service nova] Creating event network-changed:9b78d397-c172-459c-b216-ef5a6b700eb2 for instance 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd on hv-cinder-85535 Aug 31 11:07:26.630123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-fe824765-1b53-4a8f-8a90-076f8df8832c req-ea354a18-7c1c-4aa9-9023-3fabdc8f9661 service nova] Creating event network-changed:21aa5d3b-5335-4948-b4c1-66ad46c33844 for instance b50ff8cd-8095-43f9-9b25-30536f129ac3 on hv-cinder-85535 Aug 31 11:07:26.649083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-fe824765-1b53-4a8f-8a90-076f8df8832c req-ea354a18-7c1c-4aa9-9023-3fabdc8f9661 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.112564 Aug 31 11:07:26.651687 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 131/261] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:26.658165 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b4a0f27a-b85c-4ae5-b6ba-b22a18725925 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:26.659476 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b4a0f27a-b85c-4ae5-b6ba-b22a18725925 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:26.666985 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4a0f27a-b85c-4ae5-b6ba-b22a18725925 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:26.668234 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4a0f27a-b85c-4ae5-b6ba-b22a18725925 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:26.668234 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4a0f27a-b85c-4ae5-b6ba-b22a18725925 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:26.669329 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4a0f27a-b85c-4ae5-b6ba-b22a18725925 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:26.671544 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4a0f27a-b85c-4ae5-b6ba-b22a18725925 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:26.682886 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4a0f27a-b85c-4ae5-b6ba-b22a18725925 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:26.987375 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b4a0f27a-b85c-4ae5-b6ba-b22a18725925 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:26.997138 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b4a0f27a-b85c-4ae5-b6ba-b22a18725925 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1500 microversion: 2.1 time: 0.343902 Aug 31 11:07:27.012039 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 132/262] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:26 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1500 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:27.014796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0909310f-3820-4d69-8ab0-fa8ce850f591 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:27.015423 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-0909310f-3820-4d69-8ab0-fa8ce850f591 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:27.021913 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0909310f-3820-4d69-8ab0-fa8ce850f591 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.022414 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0909310f-3820-4d69-8ab0-fa8ce850f591 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.022850 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0909310f-3820-4d69-8ab0-fa8ce850f591 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.023565 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0909310f-3820-4d69-8ab0-fa8ce850f591 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.024094 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0909310f-3820-4d69-8ab0-fa8ce850f591 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.024466 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0909310f-3820-4d69-8ab0-fa8ce850f591 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.044621 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c460fc0e-35d3-4d17-98d5-e5ac0cb70996 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:27.054681 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c460fc0e-35d3-4d17-98d5-e5ac0cb70996 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1315 microversion: 2.1 time: 1.398333 Aug 31 11:07:27.056684 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 131/263] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:25 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1315 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:27.063299 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ac78857e-a75e-43e2-9305-65207ecd6503 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:27.064337 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ac78857e-a75e-43e2-9305-65207ecd6503 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:27.074885 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ac78857e-a75e-43e2-9305-65207ecd6503 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.075824 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ac78857e-a75e-43e2-9305-65207ecd6503 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.076650 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ac78857e-a75e-43e2-9305-65207ecd6503 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.077667 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ac78857e-a75e-43e2-9305-65207ecd6503 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.078377 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ac78857e-a75e-43e2-9305-65207ecd6503 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.079249 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ac78857e-a75e-43e2-9305-65207ecd6503 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.112414 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0909310f-3820-4d69-8ab0-fa8ce850f591 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:27.122714 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0909310f-3820-4d69-8ab0-fa8ce850f591 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1245 microversion: 2.1 time: 0.111628 Aug 31 11:07:27.134025 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 133/264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:27 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1245 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:27.144347 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d788ed48-5182-42f8-8f95-b63036c5de60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:27.145829 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d788ed48-5182-42f8-8f95-b63036c5de60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] [instance: 9c128235-7d40-4faf-a1ae-ee179935df87] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:27.153672 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d788ed48-5182-42f8-8f95-b63036c5de60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.154595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d788ed48-5182-42f8-8f95-b63036c5de60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.168543 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d788ed48-5182-42f8-8f95-b63036c5de60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.170032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d788ed48-5182-42f8-8f95-b63036c5de60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.170630 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d788ed48-5182-42f8-8f95-b63036c5de60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.171346 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d788ed48-5182-42f8-8f95-b63036c5de60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.189313 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-d788ed48-5182-42f8-8f95-b63036c5de60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] HTTP exception thrown: Instance 9c128235-7d40-4faf-a1ae-ee179935df87 could not be found. Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d788ed48-5182-42f8-8f95-b63036c5de60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Request method failure captured: Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 HTTP/1.1 Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0Cx5m4YhsEdh3-idPUNEOJ5PXAbYTSnoPvINYvO-gQfYDioQky4u9xz1qT61R3F77K2alLcRuFjkZP-lXuidX1U_qh2MPeGtoSduUFY-R0q2bbI8bWaZadZJ0jb9lWeEJZUTYRSIVE4hoLUt3XlNPvZu2_liW5wj0p5rIUXEYHrnQI Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: b2365f1500c5405aab2ea6e892fbb832 Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-VolumesActionsTest-230784548 Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:07:27.191793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:07:27.193336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b2365f1500c5405aab2ea6e892fbb832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b2365f1500c5405aab2ea6e892fbb832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b2365f1500c5405aab2ea6e892fbb832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b2365f1500c5405aab2ea6e892fbb832"}]}] Aug 31 11:07:27.193336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-VolumesActionsTest-230784548 Aug 31 11:07:27.193336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: b2365f1500c5405aab2ea6e892fbb832 Aug 31 11:07:27.193336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-VolumesActionsTest-230784548 Aug 31 11:07:27.193336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-VolumesActionsTest-230784548-project Aug 31 11:07:27.193336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:07:27.193336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:07:27.193336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: fe027aad062342688c587428f2bfbfe7 Aug 31 11:07:27.193336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-VolumesActionsTest-230784548-project Aug 31 11:07:27.193336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:07:27.193336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance 9c128235-7d40-4faf-a1ae-ee179935df87 could not be found. Aug 31 11:07:27.193336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '9c128235-7d40-4faf-a1ae-ee179935df87'} Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c128235-7d40-4faf-a1ae-ee179935df87 could not be found. Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:07:27.194022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c128235-7d40-4faf-a1ae-ee179935df87 could not be found. Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c128235-7d40-4faf-a1ae-ee179935df87 could not be found. Aug 31 11:07:27.195149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:27.199741 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d788ed48-5182-42f8-8f95-b63036c5de60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] Returning 404 to user: Instance 9c128235-7d40-4faf-a1ae-ee179935df87 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:07:27.202117 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d788ed48-5182-42f8-8f95-b63036c5de60 tempest-VolumesActionsTest-230784548 tempest-VolumesActionsTest-230784548-project] 10.222.0.20 "GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87" status: 404 len: 111 microversion: 2.1 time: 0.065316 Aug 31 11:07:27.203726 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 134/265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:27 2022] GET /compute/v2.1/servers/9c128235-7d40-4faf-a1ae-ee179935df87 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:07:27.216278 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fe714346-8b68-4c79-9ee8-6f26da417a3b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bd78597-7ec3-4aff-ac08-b754f0ccb1a5"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:27.219824 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fe714346-8b68-4c79-9ee8-6f26da417a3b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:27.229581 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fe714346-8b68-4c79-9ee8-6f26da417a3b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.230634 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fe714346-8b68-4c79-9ee8-6f26da417a3b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.231297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fe714346-8b68-4c79-9ee8-6f26da417a3b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.232619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fe714346-8b68-4c79-9ee8-6f26da417a3b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.233526 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fe714346-8b68-4c79-9ee8-6f26da417a3b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.234443 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fe714346-8b68-4c79-9ee8-6f26da417a3b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.303512 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-fe714346-8b68-4c79-9ee8-6f26da417a3b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] HTTP exception thrown: Cannot 'attach_volume' instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e while it is in vm_state rescued Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fe714346-8b68-4c79-9ee8-6f26da417a3b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Request method failure captured: Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: POST /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e/os-volume_attachments HTTP/1.1 Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 74 Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0B3pxnNtheXxMA108K-k3aets4iDu1xumVDmbwkNyulZyujoyRzznHgfG-H745bhKzmC_tincuwf2-1k2WKMJBp3v_5eKOI2HXs-BSvvXLY5ppaBAEot0sxP3oNxqcqTMTOtvZEHhj2BQuPOndfD2LNaMReJc2hJWcOZYGeTmQONow Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 9ceec51e430e4a00b407068a2243be63 Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:07:27.309856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:07:27.311238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ceec51e430e4a00b407068a2243be63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ceec51e430e4a00b407068a2243be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ceec51e430e4a00b407068a2243be63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ceec51e430e4a00b407068a2243be63"}]}] Aug 31 11:07:27.311238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:07:27.311238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 9ceec51e430e4a00b407068a2243be63 Aug 31 11:07:27.311238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:07:27.311238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-ServerRescueNegativeTestJSON-92711221-project Aug 31 11:07:27.311238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:07:27.311238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:07:27.311238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 19643be9952649aba81e61d5d55290c4 Aug 31 11:07:27.311238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-ServerRescueNegativeTestJSON-92711221-project Aug 31 11:07:27.311238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Aug 31 11:07:27.311238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {"volumeAttachment": {"volumeId": "5bd78597-7ec3-4aff-ac08-b754f0ccb1a5"}} Aug 31 11:07:27.311238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Cannot 'attach_volume' instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e while it is in vm_state rescued Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'server_id': 'fdc9445a-04e3-40f8-a633-1a8cfa00c35e', 'body': {'volumeAttachment': {'volumeId': '5bd78597-7ec3-4aff-ac08-b754f0ccb1a5'}}} Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:07:27.311981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e while it is in vm_state rescued Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:07:27.313033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:07:27.314201 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:07:27.314201 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:07:27.314201 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e while it is in vm_state rescued Aug 31 11:07:27.314201 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:27.314201 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fe714346-8b68-4c79-9ee8-6f26da417a3b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Returning 409 to user: Cannot 'attach_volume' instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e while it is in vm_state rescued {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:07:27.314201 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fe714346-8b68-4c79-9ee8-6f26da417a3b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "POST /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.108593 Aug 31 11:07:27.322110 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 135/266] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:07:27 2022] POST /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e/os-volume_attachments => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 11:07:27.339049 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f004c3aa-66ba-4b5b-a187-edeb6a125231 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:27.339746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f004c3aa-66ba-4b5b-a187-edeb6a125231 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:27.360582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f004c3aa-66ba-4b5b-a187-edeb6a125231 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.361379 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f004c3aa-66ba-4b5b-a187-edeb6a125231 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.361481 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f004c3aa-66ba-4b5b-a187-edeb6a125231 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.366612 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f004c3aa-66ba-4b5b-a187-edeb6a125231 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.368357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f004c3aa-66ba-4b5b-a187-edeb6a125231 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.370886 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f004c3aa-66ba-4b5b-a187-edeb6a125231 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.566795 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f004c3aa-66ba-4b5b-a187-edeb6a125231 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:27.579639 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f004c3aa-66ba-4b5b-a187-edeb6a125231 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1316 microversion: 2.1 time: 0.256334 Aug 31 11:07:27.583627 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 136/267] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:27 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:27.601382 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6d533dbb-7f3d-4b68-8f73-213c0eaac1a4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:27.603719 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6d533dbb-7f3d-4b68-8f73-213c0eaac1a4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:27.626181 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d533dbb-7f3d-4b68-8f73-213c0eaac1a4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.628698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d533dbb-7f3d-4b68-8f73-213c0eaac1a4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.632454 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d533dbb-7f3d-4b68-8f73-213c0eaac1a4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.655227 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d533dbb-7f3d-4b68-8f73-213c0eaac1a4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.659354 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d533dbb-7f3d-4b68-8f73-213c0eaac1a4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.660763 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d533dbb-7f3d-4b68-8f73-213c0eaac1a4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.984727 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6d533dbb-7f3d-4b68-8f73-213c0eaac1a4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "POST /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e/action" status: 202 len: 0 microversion: 2.1 time: 0.398626 Aug 31 11:07:27.989656 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 137/268] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:07:27 2022] POST /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:07:28.011842 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-85939597-ab8b-4874-9475-012bd573413e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:28.013309 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-85939597-ab8b-4874-9475-012bd573413e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:28.033220 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-85939597-ab8b-4874-9475-012bd573413e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:28.034202 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-85939597-ab8b-4874-9475-012bd573413e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:28.035490 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-85939597-ab8b-4874-9475-012bd573413e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:28.036610 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-85939597-ab8b-4874-9475-012bd573413e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:28.037576 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-85939597-ab8b-4874-9475-012bd573413e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:28.038198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-85939597-ab8b-4874-9475-012bd573413e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:28.743817 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-85939597-ab8b-4874-9475-012bd573413e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:28.754869 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-85939597-ab8b-4874-9475-012bd573413e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1364 microversion: 2.1 time: 0.761235 Aug 31 11:07:28.756455 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 138/269] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:27 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1364 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:28.762834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-27d3fb76-9a19-441e-92d7-117418586bd9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:28.763719 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-27d3fb76-9a19-441e-92d7-117418586bd9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:28.784649 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-27d3fb76-9a19-441e-92d7-117418586bd9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:28.785243 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-27d3fb76-9a19-441e-92d7-117418586bd9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:28.788540 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-27d3fb76-9a19-441e-92d7-117418586bd9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:28.789525 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-27d3fb76-9a19-441e-92d7-117418586bd9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:28.790088 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-27d3fb76-9a19-441e-92d7-117418586bd9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:28.790584 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-27d3fb76-9a19-441e-92d7-117418586bd9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:28.798992 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ac78857e-a75e-43e2-9305-65207ecd6503 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:28.809245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ac78857e-a75e-43e2-9305-65207ecd6503 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:28.810747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ac78857e-a75e-43e2-9305-65207ecd6503 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:28.817694 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ac78857e-a75e-43e2-9305-65207ecd6503 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1725 microversion: 2.20 time: 1.759662 Aug 31 11:07:28.818572 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 132/270] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:27 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1725 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:28.827462 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c766d28a-8725-4900-83ed-3e6499833bd6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:28.832363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c766d28a-8725-4900-83ed-3e6499833bd6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:28.844620 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c766d28a-8725-4900-83ed-3e6499833bd6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:28.846968 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c766d28a-8725-4900-83ed-3e6499833bd6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:28.847842 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c766d28a-8725-4900-83ed-3e6499833bd6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:28.849904 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c766d28a-8725-4900-83ed-3e6499833bd6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:28.852431 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c766d28a-8725-4900-83ed-3e6499833bd6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:28.854499 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c766d28a-8725-4900-83ed-3e6499833bd6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:29.082026 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-27d3fb76-9a19-441e-92d7-117418586bd9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:29.103606 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-27d3fb76-9a19-441e-92d7-117418586bd9 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1508 microversion: 2.1 time: 0.345219 Aug 31 11:07:29.104623 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 139/271] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:28 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1508 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:29.153306 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a96383d2-5816-414e-8d50-ee37e5064207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:29.159553 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a96383d2-5816-414e-8d50-ee37e5064207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:29.179464 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a96383d2-5816-414e-8d50-ee37e5064207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:29.182112 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a96383d2-5816-414e-8d50-ee37e5064207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:29.187767 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a96383d2-5816-414e-8d50-ee37e5064207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:29.194317 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a96383d2-5816-414e-8d50-ee37e5064207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:29.201809 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a96383d2-5816-414e-8d50-ee37e5064207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:29.202352 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a96383d2-5816-414e-8d50-ee37e5064207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:29.294637 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a96383d2-5816-414e-8d50-ee37e5064207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:29.326438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a96383d2-5816-414e-8d50-ee37e5064207 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1293 microversion: 2.1 time: 0.188573 Aug 31 11:07:29.327027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 140/272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:29 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1293 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:29.382634 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-efab7a0b-cac8-49f0-ac09-a67a584a50e5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:29.383475 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-efab7a0b-cac8-49f0-ac09-a67a584a50e5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:29.402021 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-efab7a0b-cac8-49f0-ac09-a67a584a50e5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:29.402529 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-efab7a0b-cac8-49f0-ac09-a67a584a50e5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:29.402973 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-efab7a0b-cac8-49f0-ac09-a67a584a50e5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:29.403696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-efab7a0b-cac8-49f0-ac09-a67a584a50e5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:29.404185 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-efab7a0b-cac8-49f0-ac09-a67a584a50e5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:29.404616 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-efab7a0b-cac8-49f0-ac09-a67a584a50e5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:29.796059 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c766d28a-8725-4900-83ed-3e6499833bd6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:29.809593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c766d28a-8725-4900-83ed-3e6499833bd6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1315 microversion: 2.1 time: 0.989627 Aug 31 11:07:29.822934 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 133/273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:28 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1315 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:29.828173 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0ae162d3-332f-4d34-8998-a900fc2d9f0b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:29.828794 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0ae162d3-332f-4d34-8998-a900fc2d9f0b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:29.844427 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-efab7a0b-cac8-49f0-ac09-a67a584a50e5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:29.848886 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0ae162d3-332f-4d34-8998-a900fc2d9f0b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:29.849383 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0ae162d3-332f-4d34-8998-a900fc2d9f0b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:29.849821 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0ae162d3-332f-4d34-8998-a900fc2d9f0b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:29.850610 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0ae162d3-332f-4d34-8998-a900fc2d9f0b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:29.851069 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0ae162d3-332f-4d34-8998-a900fc2d9f0b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:29.851497 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0ae162d3-332f-4d34-8998-a900fc2d9f0b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:29.853808 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-efab7a0b-cac8-49f0-ac09-a67a584a50e5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 0.503677 Aug 31 11:07:29.866941 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 141/274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:29 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:29.876077 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0adce140-d858-40dd-8071-329a193196f7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:29.877016 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-0adce140-d858-40dd-8071-329a193196f7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:29.887123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0adce140-d858-40dd-8071-329a193196f7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:29.887123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0adce140-d858-40dd-8071-329a193196f7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:29.887123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0adce140-d858-40dd-8071-329a193196f7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:29.887123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0adce140-d858-40dd-8071-329a193196f7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:29.887934 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0adce140-d858-40dd-8071-329a193196f7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:29.889617 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0adce140-d858-40dd-8071-329a193196f7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:30.076918 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0adce140-d858-40dd-8071-329a193196f7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:30.088362 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0adce140-d858-40dd-8071-329a193196f7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:30.091025 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0adce140-d858-40dd-8071-329a193196f7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:30.092592 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0adce140-d858-40dd-8071-329a193196f7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1725 microversion: 2.20 time: 0.236827 Aug 31 11:07:30.093360 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 142/275] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:29 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:30.150919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-00a5c309-ec39-488b-9263-d203f067bb11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:30.151958 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-00a5c309-ec39-488b-9263-d203f067bb11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:30.159927 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00a5c309-ec39-488b-9263-d203f067bb11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:30.160777 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00a5c309-ec39-488b-9263-d203f067bb11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:30.161769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00a5c309-ec39-488b-9263-d203f067bb11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:30.162669 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00a5c309-ec39-488b-9263-d203f067bb11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:30.163287 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00a5c309-ec39-488b-9263-d203f067bb11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:30.163862 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00a5c309-ec39-488b-9263-d203f067bb11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:30.200171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0ae162d3-332f-4d34-8998-a900fc2d9f0b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:30.218790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0ae162d3-332f-4d34-8998-a900fc2d9f0b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1364 microversion: 2.1 time: 0.394618 Aug 31 11:07:30.227033 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 134/276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:29 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1364 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:30.354700 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-70d38645-aed3-4d21-9a10-7f212e457a70 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:30.356467 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-70d38645-aed3-4d21-9a10-7f212e457a70 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:30.372352 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-70d38645-aed3-4d21-9a10-7f212e457a70 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:30.378418 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-70d38645-aed3-4d21-9a10-7f212e457a70 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:30.380686 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-70d38645-aed3-4d21-9a10-7f212e457a70 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:30.381840 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-70d38645-aed3-4d21-9a10-7f212e457a70 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:30.382561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-70d38645-aed3-4d21-9a10-7f212e457a70 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:30.383254 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-70d38645-aed3-4d21-9a10-7f212e457a70 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:30.445875 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-00a5c309-ec39-488b-9263-d203f067bb11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:30.460321 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-00a5c309-ec39-488b-9263-d203f067bb11 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1508 microversion: 2.1 time: 0.327368 Aug 31 11:07:30.482200 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 143/277] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:30 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:30.524622 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=3 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:30.565303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-70d38645-aed3-4d21-9a10-7f212e457a70 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:30.576780 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-70d38645-aed3-4d21-9a10-7f212e457a70 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1293 microversion: 2.1 time: 0.227645 Aug 31 11:07:30.589098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 135/278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:30 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1293 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:30.831881 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-af41e74f-b492-4782-97e9-c2af8aef68fe tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:30.833645 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-af41e74f-b492-4782-97e9-c2af8aef68fe tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:30.864717 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-af41e74f-b492-4782-97e9-c2af8aef68fe tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:30.866214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-af41e74f-b492-4782-97e9-c2af8aef68fe tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:30.866824 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-af41e74f-b492-4782-97e9-c2af8aef68fe tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:30.867703 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-af41e74f-b492-4782-97e9-c2af8aef68fe tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:30.868572 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-af41e74f-b492-4782-97e9-c2af8aef68fe tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:30.869551 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-af41e74f-b492-4782-97e9-c2af8aef68fe tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:30.875355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5f7c4811-9841-40a4-b432-a0a792118ea7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:30.876840 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-5f7c4811-9841-40a4-b432-a0a792118ea7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:30.888258 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5f7c4811-9841-40a4-b432-a0a792118ea7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:30.896066 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5f7c4811-9841-40a4-b432-a0a792118ea7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:30.897049 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5f7c4811-9841-40a4-b432-a0a792118ea7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:30.897986 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5f7c4811-9841-40a4-b432-a0a792118ea7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:30.900664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5f7c4811-9841-40a4-b432-a0a792118ea7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:30.906888 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5f7c4811-9841-40a4-b432-a0a792118ea7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:31.218645 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-af41e74f-b492-4782-97e9-c2af8aef68fe tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:31.241582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-af41e74f-b492-4782-97e9-c2af8aef68fe tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1315 microversion: 2.1 time: 0.409597 Aug 31 11:07:31.245260 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 144/279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:30 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:31.280065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-51a9209f-5069-4804-a5b1-2c291f8254d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:31.280065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-51a9209f-5069-4804-a5b1-2c291f8254d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:31.312678 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-51a9209f-5069-4804-a5b1-2c291f8254d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:31.314285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-51a9209f-5069-4804-a5b1-2c291f8254d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:31.314885 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-51a9209f-5069-4804-a5b1-2c291f8254d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:31.315615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-51a9209f-5069-4804-a5b1-2c291f8254d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:31.316102 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-51a9209f-5069-4804-a5b1-2c291f8254d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:31.320329 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-51a9209f-5069-4804-a5b1-2c291f8254d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:31.683672 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-51a9209f-5069-4804-a5b1-2c291f8254d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:31.706076 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-51a9209f-5069-4804-a5b1-2c291f8254d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:31.707695 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-51a9209f-5069-4804-a5b1-2c291f8254d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:31.709117 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-51a9209f-5069-4804-a5b1-2c291f8254d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1725 microversion: 2.20 time: 0.459091 Aug 31 11:07:31.716177 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 145/280] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:31 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1725 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:31.746059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fe205f83-ee08-4047-ae67-4abf80c3f655 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:31.746787 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fe205f83-ee08-4047-ae67-4abf80c3f655 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:31.753635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fe205f83-ee08-4047-ae67-4abf80c3f655 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:31.754345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fe205f83-ee08-4047-ae67-4abf80c3f655 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:31.754790 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fe205f83-ee08-4047-ae67-4abf80c3f655 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:31.755597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fe205f83-ee08-4047-ae67-4abf80c3f655 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:31.756125 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fe205f83-ee08-4047-ae67-4abf80c3f655 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:31.756589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fe205f83-ee08-4047-ae67-4abf80c3f655 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:31.762560 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:31.805491 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5f7c4811-9841-40a4-b432-a0a792118ea7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:31.815376 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-5f7c4811-9841-40a4-b432-a0a792118ea7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 0.943795 Aug 31 11:07:31.815892 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 136/281] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:30 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:31.826342 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4f2921ec-f521-4dc2-81a3-31c7030db78f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:31.829185 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-4f2921ec-f521-4dc2-81a3-31c7030db78f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:31.836413 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4f2921ec-f521-4dc2-81a3-31c7030db78f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:31.837652 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4f2921ec-f521-4dc2-81a3-31c7030db78f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:31.838308 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4f2921ec-f521-4dc2-81a3-31c7030db78f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:31.839299 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4f2921ec-f521-4dc2-81a3-31c7030db78f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:31.839926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4f2921ec-f521-4dc2-81a3-31c7030db78f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:31.840479 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4f2921ec-f521-4dc2-81a3-31c7030db78f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:31.844773 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=100 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:31.944736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fe205f83-ee08-4047-ae67-4abf80c3f655 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:31.956215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fe205f83-ee08-4047-ae67-4abf80c3f655 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1364 microversion: 2.1 time: 0.244604 Aug 31 11:07:31.957935 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 146/282] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:31 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:31.973508 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ac7f625f-b173-44a9-b51c-f18f0fec5ea7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:31.974530 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ac7f625f-b173-44a9-b51c-f18f0fec5ea7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:31.981667 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac7f625f-b173-44a9-b51c-f18f0fec5ea7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:31.982486 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac7f625f-b173-44a9-b51c-f18f0fec5ea7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:31.983237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac7f625f-b173-44a9-b51c-f18f0fec5ea7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:31.984215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac7f625f-b173-44a9-b51c-f18f0fec5ea7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:31.984851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac7f625f-b173-44a9-b51c-f18f0fec5ea7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:31.985493 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac7f625f-b173-44a9-b51c-f18f0fec5ea7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:32.060684 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ac7f625f-b173-44a9-b51c-f18f0fec5ea7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:32.068960 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ac7f625f-b173-44a9-b51c-f18f0fec5ea7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1293 microversion: 2.1 time: 0.109577 Aug 31 11:07:32.069641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 147/283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:31 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:32.104338 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4f2921ec-f521-4dc2-81a3-31c7030db78f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:32.112555 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4f2921ec-f521-4dc2-81a3-31c7030db78f tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1508 microversion: 2.1 time: 0.293479 Aug 31 11:07:32.113396 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 137/284] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:31 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1508 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:32.268206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-32a63995-c079-4f32-91c1-6d4a45c621a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:32.268832 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-32a63995-c079-4f32-91c1-6d4a45c621a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:32.280476 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32a63995-c079-4f32-91c1-6d4a45c621a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:32.281285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32a63995-c079-4f32-91c1-6d4a45c621a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:32.281718 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32a63995-c079-4f32-91c1-6d4a45c621a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:32.282471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32a63995-c079-4f32-91c1-6d4a45c621a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:32.282921 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32a63995-c079-4f32-91c1-6d4a45c621a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:32.283367 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32a63995-c079-4f32-91c1-6d4a45c621a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:32.638563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-32a63995-c079-4f32-91c1-6d4a45c621a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:32.660960 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-32a63995-c079-4f32-91c1-6d4a45c621a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1315 microversion: 2.1 time: 0.398100 Aug 31 11:07:32.674710 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 148/285] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:32 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:32.733783 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c2719abc-d900-4a5b-8139-09ccd01482ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:32.734394 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c2719abc-d900-4a5b-8139-09ccd01482ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:32.743254 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c2719abc-d900-4a5b-8139-09ccd01482ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:32.744159 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c2719abc-d900-4a5b-8139-09ccd01482ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:32.744760 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c2719abc-d900-4a5b-8139-09ccd01482ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:32.745667 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c2719abc-d900-4a5b-8139-09ccd01482ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:32.746284 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c2719abc-d900-4a5b-8139-09ccd01482ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:32.746867 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c2719abc-d900-4a5b-8139-09ccd01482ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:32.921950 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2da1fccc-b5b0-4bda-9bce-b0feba52356d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:32.923035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2da1fccc-b5b0-4bda-9bce-b0feba52356d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:32.937435 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2da1fccc-b5b0-4bda-9bce-b0feba52356d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:32.938159 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2da1fccc-b5b0-4bda-9bce-b0feba52356d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:32.938784 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2da1fccc-b5b0-4bda-9bce-b0feba52356d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:32.949055 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2da1fccc-b5b0-4bda-9bce-b0feba52356d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:32.950368 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2da1fccc-b5b0-4bda-9bce-b0feba52356d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:32.951071 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2da1fccc-b5b0-4bda-9bce-b0feba52356d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:33.253458 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c2719abc-d900-4a5b-8139-09ccd01482ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:33.281470 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c2719abc-d900-4a5b-8139-09ccd01482ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:33.285484 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c2719abc-d900-4a5b-8139-09ccd01482ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:33.287317 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c2719abc-d900-4a5b-8139-09ccd01482ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1725 microversion: 2.20 time: 0.557380 Aug 31 11:07:33.301312 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 138/286] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:32 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1725 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:33.314222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c8916d0a-60b8-4f5b-9522-eb7223baafbc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:33.315278 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c8916d0a-60b8-4f5b-9522-eb7223baafbc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:33.323054 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c8916d0a-60b8-4f5b-9522-eb7223baafbc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:33.323824 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c8916d0a-60b8-4f5b-9522-eb7223baafbc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:33.324526 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c8916d0a-60b8-4f5b-9522-eb7223baafbc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:33.325405 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c8916d0a-60b8-4f5b-9522-eb7223baafbc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:33.326007 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c8916d0a-60b8-4f5b-9522-eb7223baafbc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:33.326574 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c8916d0a-60b8-4f5b-9522-eb7223baafbc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:33.570271 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2da1fccc-b5b0-4bda-9bce-b0feba52356d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:33.585061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2da1fccc-b5b0-4bda-9bce-b0feba52356d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 0.750229 Aug 31 11:07:33.587891 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 149/287] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:32 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:33.595568 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-08669c53-7a52-4c5e-a93d-aacb1c450aca tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:33.606175 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-08669c53-7a52-4c5e-a93d-aacb1c450aca tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:33.621878 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-08669c53-7a52-4c5e-a93d-aacb1c450aca tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:33.624188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-08669c53-7a52-4c5e-a93d-aacb1c450aca tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:33.624748 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-08669c53-7a52-4c5e-a93d-aacb1c450aca tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:33.629427 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-08669c53-7a52-4c5e-a93d-aacb1c450aca tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:33.630285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-08669c53-7a52-4c5e-a93d-aacb1c450aca tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:33.630988 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-08669c53-7a52-4c5e-a93d-aacb1c450aca tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:33.794383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-08669c53-7a52-4c5e-a93d-aacb1c450aca tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:33.818980 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-08669c53-7a52-4c5e-a93d-aacb1c450aca tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1293 microversion: 2.1 time: 0.218321 Aug 31 11:07:33.822378 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 150/288] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:33 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1293 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:33.833064 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-627168af-0b10-4e76-a2d5-c4faab43fd9a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:33.834075 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-627168af-0b10-4e76-a2d5-c4faab43fd9a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:33.844668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-627168af-0b10-4e76-a2d5-c4faab43fd9a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:33.853046 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-627168af-0b10-4e76-a2d5-c4faab43fd9a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:33.853879 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-627168af-0b10-4e76-a2d5-c4faab43fd9a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:33.854851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-627168af-0b10-4e76-a2d5-c4faab43fd9a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:33.856304 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-627168af-0b10-4e76-a2d5-c4faab43fd9a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:33.857122 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-627168af-0b10-4e76-a2d5-c4faab43fd9a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:34.369776 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c8916d0a-60b8-4f5b-9522-eb7223baafbc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:34.397861 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c8916d0a-60b8-4f5b-9522-eb7223baafbc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1364 microversion: 2.1 time: 1.095447 Aug 31 11:07:34.405790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 139/289] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:33 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1364 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:34.429954 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3e3f70e3-de92-4a70-9bee-caf56cb64e5b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:34.435906 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3e3f70e3-de92-4a70-9bee-caf56cb64e5b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:34.458117 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e3f70e3-de92-4a70-9bee-caf56cb64e5b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:34.461813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e3f70e3-de92-4a70-9bee-caf56cb64e5b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:34.463355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e3f70e3-de92-4a70-9bee-caf56cb64e5b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:34.467223 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e3f70e3-de92-4a70-9bee-caf56cb64e5b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:34.472443 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e3f70e3-de92-4a70-9bee-caf56cb64e5b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:34.473734 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e3f70e3-de92-4a70-9bee-caf56cb64e5b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:34.551150 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-627168af-0b10-4e76-a2d5-c4faab43fd9a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:34.591244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-627168af-0b10-4e76-a2d5-c4faab43fd9a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1508 microversion: 2.1 time: 0.765185 Aug 31 11:07:34.594053 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 151/290] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:33 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1508 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:34.621800 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9e8a6ceb-e663-4b9a-ae79-9b69c9020b7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:34.623044 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9e8a6ceb-e663-4b9a-ae79-9b69c9020b7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:34.634988 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9e8a6ceb-e663-4b9a-ae79-9b69c9020b7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:34.635773 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9e8a6ceb-e663-4b9a-ae79-9b69c9020b7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:34.636400 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9e8a6ceb-e663-4b9a-ae79-9b69c9020b7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:34.638131 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9e8a6ceb-e663-4b9a-ae79-9b69c9020b7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:34.638751 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9e8a6ceb-e663-4b9a-ae79-9b69c9020b7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:34.639575 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9e8a6ceb-e663-4b9a-ae79-9b69c9020b7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:35.314622 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9e8a6ceb-e663-4b9a-ae79-9b69c9020b7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:35.328829 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9e8a6ceb-e663-4b9a-ae79-9b69c9020b7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:35.338256 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9e8a6ceb-e663-4b9a-ae79-9b69c9020b7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:35.346044 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9e8a6ceb-e663-4b9a-ae79-9b69c9020b7e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1746 microversion: 2.20 time: 0.745941 Aug 31 11:07:35.347033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 152/291] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:34 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1746 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:35.358532 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-cf0fc4d9-f04e-4515-86af-0bf6471c5c81 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:35.368356 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-cf0fc4d9-f04e-4515-86af-0bf6471c5c81 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:35.385443 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cf0fc4d9-f04e-4515-86af-0bf6471c5c81 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:35.386940 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cf0fc4d9-f04e-4515-86af-0bf6471c5c81 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:35.389145 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cf0fc4d9-f04e-4515-86af-0bf6471c5c81 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:35.390130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cf0fc4d9-f04e-4515-86af-0bf6471c5c81 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:35.392790 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cf0fc4d9-f04e-4515-86af-0bf6471c5c81 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:35.393446 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cf0fc4d9-f04e-4515-86af-0bf6471c5c81 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:35.501849 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3e3f70e3-de92-4a70-9bee-caf56cb64e5b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:35.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3e3f70e3-de92-4a70-9bee-caf56cb64e5b tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1315 microversion: 2.1 time: 1.106445 Aug 31 11:07:35.517325 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 140/292] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:34 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1315 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:35.532768 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c823507f-2f5d-47c2-aeb9-546ac6468b1d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:35.534068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c823507f-2f5d-47c2-aeb9-546ac6468b1d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:35.551151 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c823507f-2f5d-47c2-aeb9-546ac6468b1d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:35.552747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c823507f-2f5d-47c2-aeb9-546ac6468b1d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:35.555423 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c823507f-2f5d-47c2-aeb9-546ac6468b1d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:35.558265 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c823507f-2f5d-47c2-aeb9-546ac6468b1d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:35.562815 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c823507f-2f5d-47c2-aeb9-546ac6468b1d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:35.563582 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c823507f-2f5d-47c2-aeb9-546ac6468b1d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:35.703237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c823507f-2f5d-47c2-aeb9-546ac6468b1d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:35.718611 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c823507f-2f5d-47c2-aeb9-546ac6468b1d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1311 microversion: 2.1 time: 0.195997 Aug 31 11:07:35.720899 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 141/293] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:35 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1311 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:35.734155 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-0144313d-3094-4115-bd3e-5c9e2e591d7f req-3a238277-7124-4f49-a3d4-02d4b399eead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd", "name": "network-vif-plugged", "status": "completed", "tag": "9b78d397-c172-459c-b216-ef5a6b700eb2"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:35.762764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-0144313d-3094-4115-bd3e-5c9e2e591d7f req-3a238277-7124-4f49-a3d4-02d4b399eead service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:35.763721 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-0144313d-3094-4115-bd3e-5c9e2e591d7f req-3a238277-7124-4f49-a3d4-02d4b399eead service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:35.765530 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-0144313d-3094-4115-bd3e-5c9e2e591d7f req-3a238277-7124-4f49-a3d4-02d4b399eead service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:35.802108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-0144313d-3094-4115-bd3e-5c9e2e591d7f req-3a238277-7124-4f49-a3d4-02d4b399eead service nova] Creating event network-vif-plugged:9b78d397-c172-459c-b216-ef5a6b700eb2 for instance 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd on hv-cinder-85535 Aug 31 11:07:35.823088 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-0144313d-3094-4115-bd3e-5c9e2e591d7f req-3a238277-7124-4f49-a3d4-02d4b399eead service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098132 Aug 31 11:07:35.826332 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 142/294] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:35.847563 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-76a2adb1-b63f-420a-b0e5-09bf67bf26c6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:35.854060 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-76a2adb1-b63f-420a-b0e5-09bf67bf26c6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:35.879883 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-76a2adb1-b63f-420a-b0e5-09bf67bf26c6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:35.880376 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-76a2adb1-b63f-420a-b0e5-09bf67bf26c6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:35.880816 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-76a2adb1-b63f-420a-b0e5-09bf67bf26c6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:35.883854 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-76a2adb1-b63f-420a-b0e5-09bf67bf26c6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:35.884432 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-76a2adb1-b63f-420a-b0e5-09bf67bf26c6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:35.884979 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-76a2adb1-b63f-420a-b0e5-09bf67bf26c6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:35.923112 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=6 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:35.957479 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=20 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:36.283591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-cf0fc4d9-f04e-4515-86af-0bf6471c5c81 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:36.297146 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-cf0fc4d9-f04e-4515-86af-0bf6471c5c81 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 0.948700 Aug 31 11:07:36.307945 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 153/295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:35 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:36.358839 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7042643e-482a-4698-886c-3b59e317d885 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:36.361040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7042643e-482a-4698-886c-3b59e317d885 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:36.383076 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7042643e-482a-4698-886c-3b59e317d885 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:36.384791 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7042643e-482a-4698-886c-3b59e317d885 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:36.385475 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7042643e-482a-4698-886c-3b59e317d885 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:36.386426 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7042643e-482a-4698-886c-3b59e317d885 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:36.387141 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7042643e-482a-4698-886c-3b59e317d885 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:36.387799 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7042643e-482a-4698-886c-3b59e317d885 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:36.525558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-76a2adb1-b63f-420a-b0e5-09bf67bf26c6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:36.543029 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-76a2adb1-b63f-420a-b0e5-09bf67bf26c6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1364 microversion: 2.1 time: 0.713186 Aug 31 11:07:36.557965 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 143/296] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:35 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1364 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:36.596372 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d6fbd35c-f309-4a6b-a200-1553e6c90784 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:36.608514 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d6fbd35c-f309-4a6b-a200-1553e6c90784 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:36.636579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d6fbd35c-f309-4a6b-a200-1553e6c90784 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:36.643149 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d6fbd35c-f309-4a6b-a200-1553e6c90784 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:36.643961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d6fbd35c-f309-4a6b-a200-1553e6c90784 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:36.646772 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d6fbd35c-f309-4a6b-a200-1553e6c90784 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:36.653204 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d6fbd35c-f309-4a6b-a200-1553e6c90784 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:36.654924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d6fbd35c-f309-4a6b-a200-1553e6c90784 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:37.346394 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7042643e-482a-4698-886c-3b59e317d885 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:37.366339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7042643e-482a-4698-886c-3b59e317d885 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1508 microversion: 2.1 time: 1.055715 Aug 31 11:07:37.374805 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 154/297] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:36 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1508 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:37.381997 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ee9dbafd-6aad-48c2-9583-55442e30047e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:37.413086 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ee9dbafd-6aad-48c2-9583-55442e30047e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:37.435946 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ee9dbafd-6aad-48c2-9583-55442e30047e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:37.437239 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ee9dbafd-6aad-48c2-9583-55442e30047e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:37.440304 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ee9dbafd-6aad-48c2-9583-55442e30047e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:37.449049 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ee9dbafd-6aad-48c2-9583-55442e30047e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:37.453922 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ee9dbafd-6aad-48c2-9583-55442e30047e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:37.454505 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ee9dbafd-6aad-48c2-9583-55442e30047e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:38.160876 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d6fbd35c-f309-4a6b-a200-1553e6c90784 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:38.175061 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d6fbd35c-f309-4a6b-a200-1553e6c90784 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:38.184116 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d6fbd35c-f309-4a6b-a200-1553e6c90784 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:38.186453 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d6fbd35c-f309-4a6b-a200-1553e6c90784 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1746 microversion: 2.20 time: 1.627025 Aug 31 11:07:38.190365 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 144/298] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:36 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1746 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:38.217488 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-047903d6-9ead-4ba4-ba50-0579f4eadff9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:38.218044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-047903d6-9ead-4ba4-ba50-0579f4eadff9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:38.236480 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-047903d6-9ead-4ba4-ba50-0579f4eadff9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:38.237385 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-047903d6-9ead-4ba4-ba50-0579f4eadff9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:38.238102 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-047903d6-9ead-4ba4-ba50-0579f4eadff9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:38.240577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-047903d6-9ead-4ba4-ba50-0579f4eadff9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:38.243813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-047903d6-9ead-4ba4-ba50-0579f4eadff9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:38.244798 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-047903d6-9ead-4ba4-ba50-0579f4eadff9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:38.528092 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-047903d6-9ead-4ba4-ba50-0579f4eadff9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:38.543392 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-047903d6-9ead-4ba4-ba50-0579f4eadff9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1299 microversion: 2.1 time: 0.327673 Aug 31 11:07:38.545421 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 145/299] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:38 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1299 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:38.559291 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7c2c50f5-8ba5-4ec9-9be5-dbaf144229fb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:38.572863 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-7c2c50f5-8ba5-4ec9-9be5-dbaf144229fb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:38.585488 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7c2c50f5-8ba5-4ec9-9be5-dbaf144229fb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:38.589658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7c2c50f5-8ba5-4ec9-9be5-dbaf144229fb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:38.591936 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7c2c50f5-8ba5-4ec9-9be5-dbaf144229fb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:38.596141 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7c2c50f5-8ba5-4ec9-9be5-dbaf144229fb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:38.598046 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7c2c50f5-8ba5-4ec9-9be5-dbaf144229fb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:38.605923 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7c2c50f5-8ba5-4ec9-9be5-dbaf144229fb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:38.842598 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ee9dbafd-6aad-48c2-9583-55442e30047e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:38.861788 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ee9dbafd-6aad-48c2-9583-55442e30047e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1315 microversion: 2.1 time: 1.483423 Aug 31 11:07:38.889334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 155/300] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:37 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1315 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:38.899558 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-aa83b566-ded8-4ea4-82ce-dedc127b8223 req-6edf8124-b677-4e9b-b044-c03c388eb4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ab2526-7363-4846-86d8-cb2fa6705c76", "tag": "7b6fd60a-b00d-41c8-912f-b319241ebfad"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:38.912896 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-aa83b566-ded8-4ea4-82ce-dedc127b8223 req-6edf8124-b677-4e9b-b044-c03c388eb4c6 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:38.913871 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-aa83b566-ded8-4ea4-82ce-dedc127b8223 req-6edf8124-b677-4e9b-b044-c03c388eb4c6 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:38.914546 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-aa83b566-ded8-4ea4-82ce-dedc127b8223 req-6edf8124-b677-4e9b-b044-c03c388eb4c6 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:38.937830 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-aa83b566-ded8-4ea4-82ce-dedc127b8223 req-6edf8124-b677-4e9b-b044-c03c388eb4c6 service nova] Creating event network-changed:7b6fd60a-b00d-41c8-912f-b319241ebfad for instance f1ab2526-7363-4846-86d8-cb2fa6705c76 on hv-cinder-85535 Aug 31 11:07:38.949946 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-aa83b566-ded8-4ea4-82ce-dedc127b8223 req-6edf8124-b677-4e9b-b044-c03c388eb4c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058420 Aug 31 11:07:38.960148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 156/301] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:38.986509 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fa57d735-0d93-4b20-9c59-f22a13ade705 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:38.987334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fa57d735-0d93-4b20-9c59-f22a13ade705 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:38.995545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa57d735-0d93-4b20-9c59-f22a13ade705 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:38.996351 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa57d735-0d93-4b20-9c59-f22a13ade705 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:38.996945 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa57d735-0d93-4b20-9c59-f22a13ade705 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:39.001496 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa57d735-0d93-4b20-9c59-f22a13ade705 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:39.002221 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa57d735-0d93-4b20-9c59-f22a13ade705 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:39.003053 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa57d735-0d93-4b20-9c59-f22a13ade705 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:39.694651 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7c2c50f5-8ba5-4ec9-9be5-dbaf144229fb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:39.719297 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7c2c50f5-8ba5-4ec9-9be5-dbaf144229fb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 1.167853 Aug 31 11:07:39.730247 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 146/302] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:38 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:39.753332 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6ef160ce-74bd-4282-ade8-0608414d5187 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:39.754942 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6ef160ce-74bd-4282-ade8-0608414d5187 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:39.793733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6ef160ce-74bd-4282-ade8-0608414d5187 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:39.794717 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6ef160ce-74bd-4282-ade8-0608414d5187 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:39.798025 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6ef160ce-74bd-4282-ade8-0608414d5187 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:39.802574 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fa57d735-0d93-4b20-9c59-f22a13ade705 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:39.813579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6ef160ce-74bd-4282-ade8-0608414d5187 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:39.814735 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6ef160ce-74bd-4282-ade8-0608414d5187 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:39.815577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6ef160ce-74bd-4282-ade8-0608414d5187 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:39.828379 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fa57d735-0d93-4b20-9c59-f22a13ade705 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1364 microversion: 2.1 time: 0.864672 Aug 31 11:07:39.830389 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 157/303] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:38 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1364 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:39.835255 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-342da1c5-bb23-488a-af56-80758a44f44b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:39.835868 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-342da1c5-bb23-488a-af56-80758a44f44b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:39.887241 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-342da1c5-bb23-488a-af56-80758a44f44b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:39.890918 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-342da1c5-bb23-488a-af56-80758a44f44b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:39.895977 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-342da1c5-bb23-488a-af56-80758a44f44b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:39.903477 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-342da1c5-bb23-488a-af56-80758a44f44b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:39.910086 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-342da1c5-bb23-488a-af56-80758a44f44b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:39.911031 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-342da1c5-bb23-488a-af56-80758a44f44b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:40.361374 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-342da1c5-bb23-488a-af56-80758a44f44b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:40.379537 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-342da1c5-bb23-488a-af56-80758a44f44b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:40.381514 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-342da1c5-bb23-488a-af56-80758a44f44b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:40.384688 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-342da1c5-bb23-488a-af56-80758a44f44b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.552492 Aug 31 11:07:40.389208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 158/304] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:39 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:40.398658 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5d07e450-1245-4227-8b59-4611fd7a91e6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:40.405052 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5d07e450-1245-4227-8b59-4611fd7a91e6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:40.417071 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5d07e450-1245-4227-8b59-4611fd7a91e6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:40.420975 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5d07e450-1245-4227-8b59-4611fd7a91e6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:40.421449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5d07e450-1245-4227-8b59-4611fd7a91e6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:40.422182 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5d07e450-1245-4227-8b59-4611fd7a91e6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:40.422642 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5d07e450-1245-4227-8b59-4611fd7a91e6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:40.423251 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5d07e450-1245-4227-8b59-4611fd7a91e6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:40.482246 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6ef160ce-74bd-4282-ade8-0608414d5187 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:40.494907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6ef160ce-74bd-4282-ade8-0608414d5187 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1508 microversion: 2.1 time: 0.761801 Aug 31 11:07:40.519100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 147/305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:39 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1508 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:40.527227 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f2968f1e-710c-4b89-9acd-d2ff0f938464 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:40.527886 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-f2968f1e-710c-4b89-9acd-d2ff0f938464 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:40.542411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f2968f1e-710c-4b89-9acd-d2ff0f938464 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:40.542946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f2968f1e-710c-4b89-9acd-d2ff0f938464 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:40.547077 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f2968f1e-710c-4b89-9acd-d2ff0f938464 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:40.548889 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f2968f1e-710c-4b89-9acd-d2ff0f938464 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:40.557123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-5d07e450-1245-4227-8b59-4611fd7a91e6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:40.565952 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-5d07e450-1245-4227-8b59-4611fd7a91e6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1299 microversion: 2.1 time: 0.175233 Aug 31 11:07:40.566738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f2968f1e-710c-4b89-9acd-d2ff0f938464 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:40.567449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f2968f1e-710c-4b89-9acd-d2ff0f938464 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:40.577968 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 159/306] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:40 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:40.882823 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f16eae2a-8e96-474a-a460-7e7ff6487ccc tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Action: 'create', calling method: .version_select at 0x7f732d7cbb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1858534218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5DnT/Ikk2x5CdUnsrvOKroj2QivpLqnrCenzWaJctdSMNWs4Mgi9YYGGHK33engxhE1W7ZfahPX0mR0dxsQjUzMA9EcrH2S8uS/ijgHs+YpS+N3X7h/KUF3dukz/+ttA=="}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:40.902215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-f16eae2a-8e96-474a-a460-7e7ff6487ccc tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Getting quotas for project 42099ef23496441fab42f876b9e39efd. Resources: {'key_pairs'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:07:40.909315 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:40.910986 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-f16eae2a-8e96-474a-a460-7e7ff6487ccc tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Getting quotas for user d8c0e96bc0584d8b9be73ae920bbb055 and project 42099ef23496441fab42f876b9e39efd. Resources: {'key_pairs'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:07:40.947974 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f16eae2a-8e96-474a-a460-7e7ff6487ccc tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.366628 Aug 31 11:07:40.955348 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 160/307] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 11:07:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:40.962574 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-f1ab387b-abcd-43e8-b49a-9619d6399a8c req-10214b6c-e104-4257-8262-390f7b3c41a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e", "name": "network-vif-plugged", "status": "completed", "tag": "a2414d6d-8b79-405f-a378-ffbb986542cb"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:40.991407 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-f1ab387b-abcd-43e8-b49a-9619d6399a8c req-10214b6c-e104-4257-8262-390f7b3c41a0 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:40.996303 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-f1ab387b-abcd-43e8-b49a-9619d6399a8c req-10214b6c-e104-4257-8262-390f7b3c41a0 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:40.996902 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-f1ab387b-abcd-43e8-b49a-9619d6399a8c req-10214b6c-e104-4257-8262-390f7b3c41a0 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:41.026563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-f1ab387b-abcd-43e8-b49a-9619d6399a8c req-10214b6c-e104-4257-8262-390f7b3c41a0 service nova] Creating event network-vif-plugged:a2414d6d-8b79-405f-a378-ffbb986542cb for instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e on hv-cinder-85535 Aug 31 11:07:41.036867 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-f1ab387b-abcd-43e8-b49a-9619d6399a8c req-10214b6c-e104-4257-8262-390f7b3c41a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084318 Aug 31 11:07:41.037653 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 161/308] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:41.043573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8db357ed-1914-486c-b7b2-897e77473949 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:41.056724 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8db357ed-1914-486c-b7b2-897e77473949 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:41.069586 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8db357ed-1914-486c-b7b2-897e77473949 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:41.070309 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8db357ed-1914-486c-b7b2-897e77473949 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:41.075130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8db357ed-1914-486c-b7b2-897e77473949 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:41.076238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8db357ed-1914-486c-b7b2-897e77473949 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:41.076984 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8db357ed-1914-486c-b7b2-897e77473949 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:41.078576 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8db357ed-1914-486c-b7b2-897e77473949 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:41.360456 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-f2968f1e-710c-4b89-9acd-d2ff0f938464 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:41.373783 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-f2968f1e-710c-4b89-9acd-d2ff0f938464 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1315 microversion: 2.1 time: 0.853223 Aug 31 11:07:41.374394 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 148/309] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:40 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1315 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:41.417020 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b10e53c6-44d6-4d81-8f10-1aecf03c0b51 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:41.424720 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b10e53c6-44d6-4d81-8f10-1aecf03c0b51 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:41.458203 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b10e53c6-44d6-4d81-8f10-1aecf03c0b51 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:41.459726 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b10e53c6-44d6-4d81-8f10-1aecf03c0b51 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:41.460444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b10e53c6-44d6-4d81-8f10-1aecf03c0b51 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:41.462333 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b10e53c6-44d6-4d81-8f10-1aecf03c0b51 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:41.463549 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b10e53c6-44d6-4d81-8f10-1aecf03c0b51 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:41.464252 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b10e53c6-44d6-4d81-8f10-1aecf03c0b51 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:41.708440 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8db357ed-1914-486c-b7b2-897e77473949 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:41.722002 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8db357ed-1914-486c-b7b2-897e77473949 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 0.683209 Aug 31 11:07:41.725215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 162/310] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:41 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:41.734460 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7158922d-1692-4164-92f3-d9e4ec1cf07a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:41.735081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7158922d-1692-4164-92f3-d9e4ec1cf07a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:41.761579 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7158922d-1692-4164-92f3-d9e4ec1cf07a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:41.762080 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7158922d-1692-4164-92f3-d9e4ec1cf07a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:41.762522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7158922d-1692-4164-92f3-d9e4ec1cf07a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:41.763235 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7158922d-1692-4164-92f3-d9e4ec1cf07a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:41.786726 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7158922d-1692-4164-92f3-d9e4ec1cf07a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:41.787587 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7158922d-1692-4164-92f3-d9e4ec1cf07a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:42.185281 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b10e53c6-44d6-4d81-8f10-1aecf03c0b51 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:42.194032 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b10e53c6-44d6-4d81-8f10-1aecf03c0b51 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1364 microversion: 2.1 time: 0.818558 Aug 31 11:07:42.194616 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 149/311] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:41 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1364 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:42.212634 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8604c645-5c16-4958-9be4-1a5369e7cf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:42.213255 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8604c645-5c16-4958-9be4-1a5369e7cf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:42.240978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8604c645-5c16-4958-9be4-1a5369e7cf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:42.241414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8604c645-5c16-4958-9be4-1a5369e7cf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:42.241852 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8604c645-5c16-4958-9be4-1a5369e7cf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:42.242617 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8604c645-5c16-4958-9be4-1a5369e7cf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:42.243586 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8604c645-5c16-4958-9be4-1a5369e7cf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:42.244061 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8604c645-5c16-4958-9be4-1a5369e7cf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:42.354321 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7158922d-1692-4164-92f3-d9e4ec1cf07a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:42.370645 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7158922d-1692-4164-92f3-d9e4ec1cf07a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:42.376256 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7158922d-1692-4164-92f3-d9e4ec1cf07a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:42.380571 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7158922d-1692-4164-92f3-d9e4ec1cf07a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.651876 Aug 31 11:07:42.382291 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 163/312] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:41 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:42.389696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-75fe3f69-14a4-449b-b8e8-74cfc6836f7c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:42.390816 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-75fe3f69-14a4-449b-b8e8-74cfc6836f7c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:42.421604 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-75fe3f69-14a4-449b-b8e8-74cfc6836f7c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:42.422102 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-75fe3f69-14a4-449b-b8e8-74cfc6836f7c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:42.422561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-75fe3f69-14a4-449b-b8e8-74cfc6836f7c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:42.423272 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-75fe3f69-14a4-449b-b8e8-74cfc6836f7c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:42.423729 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-75fe3f69-14a4-449b-b8e8-74cfc6836f7c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:42.424185 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-75fe3f69-14a4-449b-b8e8-74cfc6836f7c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:42.921852 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-75fe3f69-14a4-449b-b8e8-74cfc6836f7c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:42.942256 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-75fe3f69-14a4-449b-b8e8-74cfc6836f7c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1367 microversion: 2.1 time: 0.558493 Aug 31 11:07:42.946427 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 164/313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:42 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1367 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:42.957474 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-46fbea0a-db29-473c-8935-08752a96f804 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:42.958482 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-46fbea0a-db29-473c-8935-08752a96f804 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:42.974643 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46fbea0a-db29-473c-8935-08752a96f804 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:42.975515 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46fbea0a-db29-473c-8935-08752a96f804 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:42.978934 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46fbea0a-db29-473c-8935-08752a96f804 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:42.980845 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46fbea0a-db29-473c-8935-08752a96f804 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:42.981876 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46fbea0a-db29-473c-8935-08752a96f804 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:42.984312 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46fbea0a-db29-473c-8935-08752a96f804 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:43.042124 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=100 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:43.122779 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8604c645-5c16-4958-9be4-1a5369e7cf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:43.138949 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8604c645-5c16-4958-9be4-1a5369e7cf2b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1514 microversion: 2.1 time: 0.943240 Aug 31 11:07:43.140837 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 150/314] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:42 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1514 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:43.149813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-531872bf-459a-445b-9592-c67fc85720cc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:43.152635 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-531872bf-459a-445b-9592-c67fc85720cc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:43.253060 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-531872bf-459a-445b-9592-c67fc85720cc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:43.261420 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-531872bf-459a-445b-9592-c67fc85720cc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:43.266256 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-531872bf-459a-445b-9592-c67fc85720cc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:43.274954 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-531872bf-459a-445b-9592-c67fc85720cc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:43.281993 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-531872bf-459a-445b-9592-c67fc85720cc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:43.284582 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-531872bf-459a-445b-9592-c67fc85720cc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:43.402017 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-46fbea0a-db29-473c-8935-08752a96f804 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:43.421948 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-46fbea0a-db29-473c-8935-08752a96f804 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1465 microversion: 2.1 time: 0.473769 Aug 31 11:07:43.422746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 165/315] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:42 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1465 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:43.427482 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-b40f7b72-a0e1-4764-8ef0-7e0351458029 req-9dfdf2be-7419-4e61-87d5-9db7f62381e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50ff8cd-8095-43f9-9b25-30536f129ac3", "name": "network-vif-plugged", "status": "completed", "tag": "21aa5d3b-5335-4948-b4c1-66ad46c33844"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:43.453219 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b40f7b72-a0e1-4764-8ef0-7e0351458029 req-9dfdf2be-7419-4e61-87d5-9db7f62381e2 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:43.453712 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b40f7b72-a0e1-4764-8ef0-7e0351458029 req-9dfdf2be-7419-4e61-87d5-9db7f62381e2 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:43.454148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b40f7b72-a0e1-4764-8ef0-7e0351458029 req-9dfdf2be-7419-4e61-87d5-9db7f62381e2 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:43.485209 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-b40f7b72-a0e1-4764-8ef0-7e0351458029 req-9dfdf2be-7419-4e61-87d5-9db7f62381e2 service nova] Creating event network-vif-plugged:21aa5d3b-5335-4948-b4c1-66ad46c33844 for instance b50ff8cd-8095-43f9-9b25-30536f129ac3 on hv-cinder-85535 Aug 31 11:07:43.502797 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-b40f7b72-a0e1-4764-8ef0-7e0351458029 req-9dfdf2be-7419-4e61-87d5-9db7f62381e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078523 Aug 31 11:07:43.505303 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 166/316] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:43.515080 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0cc68362-546a-4a9a-91dd-45ac5927e1f8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:43.515817 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-0cc68362-546a-4a9a-91dd-45ac5927e1f8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:43.546308 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0cc68362-546a-4a9a-91dd-45ac5927e1f8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:43.548588 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0cc68362-546a-4a9a-91dd-45ac5927e1f8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:43.548588 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0cc68362-546a-4a9a-91dd-45ac5927e1f8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:43.548588 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0cc68362-546a-4a9a-91dd-45ac5927e1f8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:43.548588 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0cc68362-546a-4a9a-91dd-45ac5927e1f8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:43.549496 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0cc68362-546a-4a9a-91dd-45ac5927e1f8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:44.021538 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0cc68362-546a-4a9a-91dd-45ac5927e1f8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:44.036484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0cc68362-546a-4a9a-91dd-45ac5927e1f8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1364 microversion: 2.1 time: 0.523388 Aug 31 11:07:44.045239 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 167/317] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:43 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1364 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:44.054288 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-30ee5167-52e2-413d-b030-312b3a5b19ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:44.057170 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-30ee5167-52e2-413d-b030-312b3a5b19ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:44.091648 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-30ee5167-52e2-413d-b030-312b3a5b19ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:44.093020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-30ee5167-52e2-413d-b030-312b3a5b19ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:44.094728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-30ee5167-52e2-413d-b030-312b3a5b19ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:44.096922 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-30ee5167-52e2-413d-b030-312b3a5b19ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:44.099206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-30ee5167-52e2-413d-b030-312b3a5b19ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:44.100648 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-30ee5167-52e2-413d-b030-312b3a5b19ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:44.532365 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-30ee5167-52e2-413d-b030-312b3a5b19ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:44.542975 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-30ee5167-52e2-413d-b030-312b3a5b19ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:44.546513 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-30ee5167-52e2-413d-b030-312b3a5b19ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:44.549462 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-30ee5167-52e2-413d-b030-312b3a5b19ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.502697 Aug 31 11:07:44.556501 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 168/318] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:44 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:44.574895 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-054359f3-bd4e-4c51-afb5-f62d28b46327 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:44.585231 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-054359f3-bd4e-4c51-afb5-f62d28b46327 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:44.602461 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-054359f3-bd4e-4c51-afb5-f62d28b46327 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:44.613059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-054359f3-bd4e-4c51-afb5-f62d28b46327 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:44.613991 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-054359f3-bd4e-4c51-afb5-f62d28b46327 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:44.615061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-054359f3-bd4e-4c51-afb5-f62d28b46327 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:44.615676 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-054359f3-bd4e-4c51-afb5-f62d28b46327 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:44.616406 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-054359f3-bd4e-4c51-afb5-f62d28b46327 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:44.695331 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-054359f3-bd4e-4c51-afb5-f62d28b46327 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:07:44.750060 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-531872bf-459a-445b-9592-c67fc85720cc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:44.767619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-531872bf-459a-445b-9592-c67fc85720cc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 1.622331 Aug 31 11:07:44.770216 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 151/319] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:43 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:44.787994 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ba0dcedf-d79b-4d45-bb24-afceeb264b82 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:44.791662 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ba0dcedf-d79b-4d45-bb24-afceeb264b82 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:44.826206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ba0dcedf-d79b-4d45-bb24-afceeb264b82 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:44.833080 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ba0dcedf-d79b-4d45-bb24-afceeb264b82 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:44.833080 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ba0dcedf-d79b-4d45-bb24-afceeb264b82 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:44.833741 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ba0dcedf-d79b-4d45-bb24-afceeb264b82 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:44.835867 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ba0dcedf-d79b-4d45-bb24-afceeb264b82 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:44.837754 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ba0dcedf-d79b-4d45-bb24-afceeb264b82 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:44.953334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-054359f3-bd4e-4c51-afb5-f62d28b46327 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "DELETE /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 204 len: 0 microversion: 2.1 time: 0.394339 Aug 31 11:07:44.964496 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 169/320] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:07:44 2022] DELETE /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:07:44.979579 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d4881954-f267-4562-a3e3-3ed1b064c8c8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:44.982160 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d4881954-f267-4562-a3e3-3ed1b064c8c8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:45.018262 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d4881954-f267-4562-a3e3-3ed1b064c8c8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:45.020933 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d4881954-f267-4562-a3e3-3ed1b064c8c8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:45.022065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d4881954-f267-4562-a3e3-3ed1b064c8c8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:45.031547 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d4881954-f267-4562-a3e3-3ed1b064c8c8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:45.032536 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d4881954-f267-4562-a3e3-3ed1b064c8c8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:45.033481 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d4881954-f267-4562-a3e3-3ed1b064c8c8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:45.425269 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ba0dcedf-d79b-4d45-bb24-afceeb264b82 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:45.443089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ba0dcedf-d79b-4d45-bb24-afceeb264b82 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1367 microversion: 2.1 time: 0.671338 Aug 31 11:07:45.443983 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 152/321] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:44 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1367 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:45.457873 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c9f00f21-79c7-4b57-8db9-8e6616c6e8d5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:45.458562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c9f00f21-79c7-4b57-8db9-8e6616c6e8d5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:45.481926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c9f00f21-79c7-4b57-8db9-8e6616c6e8d5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:45.482424 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c9f00f21-79c7-4b57-8db9-8e6616c6e8d5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:45.482865 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c9f00f21-79c7-4b57-8db9-8e6616c6e8d5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:45.483674 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c9f00f21-79c7-4b57-8db9-8e6616c6e8d5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:45.490680 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c9f00f21-79c7-4b57-8db9-8e6616c6e8d5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:45.493849 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c9f00f21-79c7-4b57-8db9-8e6616c6e8d5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:45.644273 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d4881954-f267-4562-a3e3-3ed1b064c8c8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:45.669261 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d4881954-f267-4562-a3e3-3ed1b064c8c8 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1471 microversion: 2.1 time: 0.702213 Aug 31 11:07:45.692990 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 170/322] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:44 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1471 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:45.713555 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7910b9f0-499f-44c7-abd6-85fdcd62228e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Action: 'create', calling method: .version_select at 0x7f732d5183a0>, body: {"keypair": {"name": "tempest-keypair-226963771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWXNLxVkIerNYjJq6XWZbBVbFUZpg0IJm7XNcImEqIFb3HheruMxcaVnuauJHFl4bE3QY3gAzyFQ8UvcDUe/cXieIgJvUO8dpO8EGlSTcd+/csrCSOHV6MKoAdCuPB0gw=="}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:45.755020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-7910b9f0-499f-44c7-abd6-85fdcd62228e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Getting quotas for project 9ceec51e430e4a00b407068a2243be63. Resources: {'key_pairs'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:07:45.766172 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-7910b9f0-499f-44c7-abd6-85fdcd62228e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Getting quotas for user 19643be9952649aba81e61d5d55290c4 and project 9ceec51e430e4a00b407068a2243be63. Resources: {'key_pairs'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:07:45.819510 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7910b9f0-499f-44c7-abd6-85fdcd62228e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125218 Aug 31 11:07:45.829442 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 171/323] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 11:07:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:45.835357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-016092d4-247f-4802-ad52-98ce6dfc98a9 req-39a74340-2886-4208-8dbe-0f7929c781b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962f8405-fd3a-4f34-92de-a437bdcb7845", "tag": "e7ff85c2-9219-4680-b3cd-1a1d113ea478"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:45.849648 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-016092d4-247f-4802-ad52-98ce6dfc98a9 req-39a74340-2886-4208-8dbe-0f7929c781b1 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:45.850642 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-016092d4-247f-4802-ad52-98ce6dfc98a9 req-39a74340-2886-4208-8dbe-0f7929c781b1 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:45.851369 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-016092d4-247f-4802-ad52-98ce6dfc98a9 req-39a74340-2886-4208-8dbe-0f7929c781b1 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:45.888189 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-016092d4-247f-4802-ad52-98ce6dfc98a9 req-39a74340-2886-4208-8dbe-0f7929c781b1 service nova] Creating event network-changed:e7ff85c2-9219-4680-b3cd-1a1d113ea478 for instance 962f8405-fd3a-4f34-92de-a437bdcb7845 on hv-cinder-85535 Aug 31 11:07:45.913171 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-016092d4-247f-4802-ad52-98ce6dfc98a9 req-39a74340-2886-4208-8dbe-0f7929c781b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080265 Aug 31 11:07:45.915541 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 172/324] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:45.933661 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2a6e4688-a01c-4982-a516-0e9cbd7a1908 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:45.941151 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2a6e4688-a01c-4982-a516-0e9cbd7a1908 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:45.957915 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a6e4688-a01c-4982-a516-0e9cbd7a1908 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:45.960084 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a6e4688-a01c-4982-a516-0e9cbd7a1908 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:45.965030 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a6e4688-a01c-4982-a516-0e9cbd7a1908 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:45.968269 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a6e4688-a01c-4982-a516-0e9cbd7a1908 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:45.969140 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a6e4688-a01c-4982-a516-0e9cbd7a1908 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:45.971030 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a6e4688-a01c-4982-a516-0e9cbd7a1908 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:45.983458 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c9f00f21-79c7-4b57-8db9-8e6616c6e8d5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:46.000686 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c9f00f21-79c7-4b57-8db9-8e6616c6e8d5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1364 microversion: 2.1 time: 0.555099 Aug 31 11:07:46.016058 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 153/325] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:45 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1364 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:46.025534 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3cae6f0f-9dce-4225-92e1-643360b84180 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:46.048983 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3cae6f0f-9dce-4225-92e1-643360b84180 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:46.075595 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3cae6f0f-9dce-4225-92e1-643360b84180 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:46.076238 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3cae6f0f-9dce-4225-92e1-643360b84180 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:46.076685 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3cae6f0f-9dce-4225-92e1-643360b84180 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:46.077510 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3cae6f0f-9dce-4225-92e1-643360b84180 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:46.085087 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3cae6f0f-9dce-4225-92e1-643360b84180 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:46.087962 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3cae6f0f-9dce-4225-92e1-643360b84180 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:46.134884 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=100 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:46.267457 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2a6e4688-a01c-4982-a516-0e9cbd7a1908 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:46.284091 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2a6e4688-a01c-4982-a516-0e9cbd7a1908 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:46.286191 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2a6e4688-a01c-4982-a516-0e9cbd7a1908 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:46.287716 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2a6e4688-a01c-4982-a516-0e9cbd7a1908 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.370640 Aug 31 11:07:46.288835 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 173/326] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:45 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:46.483571 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-523a22d7-5452-4d9d-b81e-b0c64ea99870 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:46.486074 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-523a22d7-5452-4d9d-b81e-b0c64ea99870 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:46.514904 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3cae6f0f-9dce-4225-92e1-643360b84180 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:46.523010 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-523a22d7-5452-4d9d-b81e-b0c64ea99870 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:46.523993 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-523a22d7-5452-4d9d-b81e-b0c64ea99870 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:46.524715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-523a22d7-5452-4d9d-b81e-b0c64ea99870 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:46.525561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3cae6f0f-9dce-4225-92e1-643360b84180 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 0.509029 Aug 31 11:07:46.526363 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-523a22d7-5452-4d9d-b81e-b0c64ea99870 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:46.527082 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-523a22d7-5452-4d9d-b81e-b0c64ea99870 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:46.527715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-523a22d7-5452-4d9d-b81e-b0c64ea99870 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:46.539825 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 154/327] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:46 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:46.716666 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-48875320-a73f-4815-8276-ccfdb8a8aa97 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:46.718537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-48875320-a73f-4815-8276-ccfdb8a8aa97 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:46.750384 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48875320-a73f-4815-8276-ccfdb8a8aa97 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:46.751483 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48875320-a73f-4815-8276-ccfdb8a8aa97 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:46.752408 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48875320-a73f-4815-8276-ccfdb8a8aa97 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:46.754029 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48875320-a73f-4815-8276-ccfdb8a8aa97 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:46.755163 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48875320-a73f-4815-8276-ccfdb8a8aa97 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:46.756640 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48875320-a73f-4815-8276-ccfdb8a8aa97 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:46.767187 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-523a22d7-5452-4d9d-b81e-b0c64ea99870 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:46.805842 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-523a22d7-5452-4d9d-b81e-b0c64ea99870 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1367 microversion: 2.1 time: 0.335075 Aug 31 11:07:46.822000 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 174/328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:46 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:07:47.053395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-72c07c3a-9706-475e-b801-86b4388be5c3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:47.054116 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-72c07c3a-9706-475e-b801-86b4388be5c3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:47.066045 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-48875320-a73f-4815-8276-ccfdb8a8aa97 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:47.068847 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-72c07c3a-9706-475e-b801-86b4388be5c3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:47.069359 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-72c07c3a-9706-475e-b801-86b4388be5c3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:47.069796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-72c07c3a-9706-475e-b801-86b4388be5c3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:47.074339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-72c07c3a-9706-475e-b801-86b4388be5c3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:47.075274 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-72c07c3a-9706-475e-b801-86b4388be5c3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:47.075977 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-72c07c3a-9706-475e-b801-86b4388be5c3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:47.089140 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-48875320-a73f-4815-8276-ccfdb8a8aa97 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1471 microversion: 2.1 time: 0.383504 Aug 31 11:07:47.090888 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 155/329] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:46 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1471 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:47.318658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-95060773-c0d7-449b-90c9-b7d83e89e62e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:47.319558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-95060773-c0d7-449b-90c9-b7d83e89e62e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:47.329286 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-95060773-c0d7-449b-90c9-b7d83e89e62e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:47.333286 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-95060773-c0d7-449b-90c9-b7d83e89e62e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:47.334041 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-95060773-c0d7-449b-90c9-b7d83e89e62e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:47.335115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-95060773-c0d7-449b-90c9-b7d83e89e62e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:47.335742 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-95060773-c0d7-449b-90c9-b7d83e89e62e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:47.339184 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-95060773-c0d7-449b-90c9-b7d83e89e62e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:47.702302 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-72c07c3a-9706-475e-b801-86b4388be5c3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:47.710345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-72c07c3a-9706-475e-b801-86b4388be5c3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1550 microversion: 2.1 time: 0.660732 Aug 31 11:07:47.715536 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 175/330] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:47 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1550 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:47.729755 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5752ee7e-4a41-448c-af79-608097b71dfd tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:47.730760 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5752ee7e-4a41-448c-af79-608097b71dfd tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:47.740661 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5752ee7e-4a41-448c-af79-608097b71dfd tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:47.741348 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5752ee7e-4a41-448c-af79-608097b71dfd tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:47.741951 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5752ee7e-4a41-448c-af79-608097b71dfd tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:47.743330 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5752ee7e-4a41-448c-af79-608097b71dfd tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:47.743968 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5752ee7e-4a41-448c-af79-608097b71dfd tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:47.745215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5752ee7e-4a41-448c-af79-608097b71dfd tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:47.775685 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-95060773-c0d7-449b-90c9-b7d83e89e62e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:47.791827 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-95060773-c0d7-449b-90c9-b7d83e89e62e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:47.793739 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-95060773-c0d7-449b-90c9-b7d83e89e62e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:47.795676 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-95060773-c0d7-449b-90c9-b7d83e89e62e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.484827 Aug 31 11:07:47.816232 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 156/331] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:47 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:07:47.822418 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a4d002c4-4327-480b-804f-fccbf7ad5a55 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:47.823166 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a4d002c4-4327-480b-804f-fccbf7ad5a55 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:47.829802 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a4d002c4-4327-480b-804f-fccbf7ad5a55 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:47.834415 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a4d002c4-4327-480b-804f-fccbf7ad5a55 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:47.835162 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a4d002c4-4327-480b-804f-fccbf7ad5a55 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:47.836676 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a4d002c4-4327-480b-804f-fccbf7ad5a55 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:47.837376 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a4d002c4-4327-480b-804f-fccbf7ad5a55 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:47.837995 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a4d002c4-4327-480b-804f-fccbf7ad5a55 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:48.051764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a4d002c4-4327-480b-804f-fccbf7ad5a55 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.233991 Aug 31 11:07:48.052495 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 157/332] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 11:07:47 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/os-interface => generated 285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:48.058403 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a9df5e7f-8f27-4055-b601-0ba78b8d03d9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:48.059392 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a9df5e7f-8f27-4055-b601-0ba78b8d03d9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:48.074217 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a9df5e7f-8f27-4055-b601-0ba78b8d03d9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:48.076963 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a9df5e7f-8f27-4055-b601-0ba78b8d03d9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:48.077885 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a9df5e7f-8f27-4055-b601-0ba78b8d03d9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:48.081711 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a9df5e7f-8f27-4055-b601-0ba78b8d03d9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:48.084338 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a9df5e7f-8f27-4055-b601-0ba78b8d03d9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:48.085232 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a9df5e7f-8f27-4055-b601-0ba78b8d03d9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:48.528555 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a9df5e7f-8f27-4055-b601-0ba78b8d03d9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:48.540337 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a9df5e7f-8f27-4055-b601-0ba78b8d03d9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1367 microversion: 2.1 time: 0.483569 Aug 31 11:07:48.541602 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 158/333] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:48 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:48.549493 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b622fabf-8331-47d8-aa2c-5c049d749425 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:48.550691 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b622fabf-8331-47d8-aa2c-5c049d749425 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:48.555385 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:48.560462 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b622fabf-8331-47d8-aa2c-5c049d749425 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:48.561382 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b622fabf-8331-47d8-aa2c-5c049d749425 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:48.562140 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b622fabf-8331-47d8-aa2c-5c049d749425 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:48.563059 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b622fabf-8331-47d8-aa2c-5c049d749425 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:48.563785 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b622fabf-8331-47d8-aa2c-5c049d749425 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:48.564438 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b622fabf-8331-47d8-aa2c-5c049d749425 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:48.751082 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b622fabf-8331-47d8-aa2c-5c049d749425 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:48.760758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b622fabf-8331-47d8-aa2c-5c049d749425 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1471 microversion: 2.1 time: 0.217624 Aug 31 11:07:48.762001 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 159/334] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:48 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1471 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:48.791907 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-5752ee7e-4a41-448c-af79-608097b71dfd tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:48.802197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-5752ee7e-4a41-448c-af79-608097b71dfd tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 1.084853 Aug 31 11:07:48.803681 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 176/335] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:47 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:48.829043 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0d007abf-bc3c-4343-9313-45fb4a61b319 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:48.829990 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0d007abf-bc3c-4343-9313-45fb4a61b319 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:48.842588 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d007abf-bc3c-4343-9313-45fb4a61b319 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:48.845141 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d007abf-bc3c-4343-9313-45fb4a61b319 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:48.845590 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d007abf-bc3c-4343-9313-45fb4a61b319 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:48.846331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d007abf-bc3c-4343-9313-45fb4a61b319 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:48.846810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d007abf-bc3c-4343-9313-45fb4a61b319 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:48.847217 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d007abf-bc3c-4343-9313-45fb4a61b319 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:49.010071 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0d007abf-bc3c-4343-9313-45fb4a61b319 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:49.021407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0d007abf-bc3c-4343-9313-45fb4a61b319 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:49.024499 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0d007abf-bc3c-4343-9313-45fb4a61b319 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:49.025911 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0d007abf-bc3c-4343-9313-45fb4a61b319 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.201676 Aug 31 11:07:49.038283 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 160/336] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:48 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:07:49.567722 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d4ae9d8e-00fc-43fc-b26d-f57156c83184 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:49.569276 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d4ae9d8e-00fc-43fc-b26d-f57156c83184 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:49.581580 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d4ae9d8e-00fc-43fc-b26d-f57156c83184 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:49.582146 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d4ae9d8e-00fc-43fc-b26d-f57156c83184 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:49.582601 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d4ae9d8e-00fc-43fc-b26d-f57156c83184 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:49.583401 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d4ae9d8e-00fc-43fc-b26d-f57156c83184 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:49.585085 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d4ae9d8e-00fc-43fc-b26d-f57156c83184 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:49.586002 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d4ae9d8e-00fc-43fc-b26d-f57156c83184 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:49.854407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b237d166-209e-4a99-8dd9-5ebf09d58f2e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:49.854407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b237d166-209e-4a99-8dd9-5ebf09d58f2e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:49.854407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b237d166-209e-4a99-8dd9-5ebf09d58f2e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:49.854407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b237d166-209e-4a99-8dd9-5ebf09d58f2e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:49.856180 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b237d166-209e-4a99-8dd9-5ebf09d58f2e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:49.856180 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b237d166-209e-4a99-8dd9-5ebf09d58f2e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:49.856180 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b237d166-209e-4a99-8dd9-5ebf09d58f2e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:49.856180 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b237d166-209e-4a99-8dd9-5ebf09d58f2e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:50.536218 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b237d166-209e-4a99-8dd9-5ebf09d58f2e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:50.559272 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b237d166-209e-4a99-8dd9-5ebf09d58f2e tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1471 microversion: 2.1 time: 0.746352 Aug 31 11:07:50.560635 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 161/337] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:49 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1471 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:07:50.587072 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c7d1e66a-0166-4c67-a021-00f5d918881e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:50.587689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c7d1e66a-0166-4c67-a021-00f5d918881e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:50.598299 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c7d1e66a-0166-4c67-a021-00f5d918881e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:50.610272 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c7d1e66a-0166-4c67-a021-00f5d918881e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:50.610272 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c7d1e66a-0166-4c67-a021-00f5d918881e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:50.610272 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c7d1e66a-0166-4c67-a021-00f5d918881e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:50.611386 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c7d1e66a-0166-4c67-a021-00f5d918881e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:50.612251 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c7d1e66a-0166-4c67-a021-00f5d918881e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:50.679269 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d4ae9d8e-00fc-43fc-b26d-f57156c83184 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:50.710487 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d4ae9d8e-00fc-43fc-b26d-f57156c83184 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1367 microversion: 2.1 time: 1.141065 Aug 31 11:07:50.733454 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 177/338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:49 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1367 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:07:50.739157 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-84755147-98eb-4748-bb3d-c086832b2cab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:50.740229 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-84755147-98eb-4748-bb3d-c086832b2cab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:50.749110 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-84755147-98eb-4748-bb3d-c086832b2cab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:50.750084 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-84755147-98eb-4748-bb3d-c086832b2cab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:50.750785 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-84755147-98eb-4748-bb3d-c086832b2cab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:50.751816 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-84755147-98eb-4748-bb3d-c086832b2cab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:50.752548 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-84755147-98eb-4748-bb3d-c086832b2cab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:50.754153 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-84755147-98eb-4748-bb3d-c086832b2cab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:51.311153 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-84755147-98eb-4748-bb3d-c086832b2cab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:51.336534 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-84755147-98eb-4748-bb3d-c086832b2cab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:51.339484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-84755147-98eb-4748-bb3d-c086832b2cab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:51.340976 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-84755147-98eb-4748-bb3d-c086832b2cab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.606163 Aug 31 11:07:51.342427 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 178/339] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:50 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:51.376267 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-208ff5e8-fb17-4e60-933d-e859c2f7d43d req-c7f80654-aee1-4dde-a3bc-19d6bcc1c394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50ff8cd-8095-43f9-9b25-30536f129ac3", "tag": "21aa5d3b-5335-4948-b4c1-66ad46c33844"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:51.406236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-208ff5e8-fb17-4e60-933d-e859c2f7d43d req-c7f80654-aee1-4dde-a3bc-19d6bcc1c394 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:51.409331 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-208ff5e8-fb17-4e60-933d-e859c2f7d43d req-c7f80654-aee1-4dde-a3bc-19d6bcc1c394 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:51.410348 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-208ff5e8-fb17-4e60-933d-e859c2f7d43d req-c7f80654-aee1-4dde-a3bc-19d6bcc1c394 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:51.424281 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c7d1e66a-0166-4c67-a021-00f5d918881e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:51.443652 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c7d1e66a-0166-4c67-a021-00f5d918881e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 0.860549 Aug 31 11:07:51.448194 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 162/340] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:50 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:51.468538 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-208ff5e8-fb17-4e60-933d-e859c2f7d43d req-c7f80654-aee1-4dde-a3bc-19d6bcc1c394 service nova] Creating event network-changed:21aa5d3b-5335-4948-b4c1-66ad46c33844 for instance b50ff8cd-8095-43f9-9b25-30536f129ac3 on hv-cinder-85535 Aug 31 11:07:51.496148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-208ff5e8-fb17-4e60-933d-e859c2f7d43d req-c7f80654-aee1-4dde-a3bc-19d6bcc1c394 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123369 Aug 31 11:07:51.497356 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 179/341] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:07:51.587705 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-fcea6c3e-3773-45f2-8b4b-0bc62fd9c2f1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:51.588527 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-fcea6c3e-3773-45f2-8b4b-0bc62fd9c2f1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:51.612251 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fcea6c3e-3773-45f2-8b4b-0bc62fd9c2f1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:51.614754 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fcea6c3e-3773-45f2-8b4b-0bc62fd9c2f1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:51.615762 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fcea6c3e-3773-45f2-8b4b-0bc62fd9c2f1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:51.618461 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fcea6c3e-3773-45f2-8b4b-0bc62fd9c2f1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:51.619517 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fcea6c3e-3773-45f2-8b4b-0bc62fd9c2f1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:51.620341 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fcea6c3e-3773-45f2-8b4b-0bc62fd9c2f1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:51.785411 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-67e44407-7f63-48bb-be74-b384fbbaf995 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:51.793007 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-67e44407-7f63-48bb-be74-b384fbbaf995 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:51.818139 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-67e44407-7f63-48bb-be74-b384fbbaf995 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:51.818671 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-67e44407-7f63-48bb-be74-b384fbbaf995 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:51.819338 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-67e44407-7f63-48bb-be74-b384fbbaf995 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:51.820564 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-67e44407-7f63-48bb-be74-b384fbbaf995 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:51.821468 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-67e44407-7f63-48bb-be74-b384fbbaf995 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:51.822103 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-67e44407-7f63-48bb-be74-b384fbbaf995 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:51.990646 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-fcea6c3e-3773-45f2-8b4b-0bc62fd9c2f1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:52.051164 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-fcea6c3e-3773-45f2-8b4b-0bc62fd9c2f1 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1429 microversion: 2.1 time: 0.468298 Aug 31 11:07:52.054111 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 163/342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:51 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1429 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:52.102412 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1844968807", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5115a138-f5d9-41a5-9c7a-63c215e1254a"}], "security_groups": [{"name": "tempest-securitygroup--802947208"}], "key_name": "tempest-keypair-226963771", "user_data": "}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:52.316708 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-67e44407-7f63-48bb-be74-b384fbbaf995 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:52.335015 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-67e44407-7f63-48bb-be74-b384fbbaf995 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1367 microversion: 2.1 time: 0.595623 Aug 31 11:07:52.341431 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 180/343] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:51 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1367 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:52.369121 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7d13555b-cb4c-4878-af90-ad622f4d6c77 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:52.370028 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7d13555b-cb4c-4878-af90-ad622f4d6c77 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:52.400498 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d13555b-cb4c-4878-af90-ad622f4d6c77 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:52.400744 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d13555b-cb4c-4878-af90-ad622f4d6c77 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:52.401081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d13555b-cb4c-4878-af90-ad622f4d6c77 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:52.401953 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d13555b-cb4c-4878-af90-ad622f4d6c77 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:52.403298 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d13555b-cb4c-4878-af90-ad622f4d6c77 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:52.403704 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d13555b-cb4c-4878-af90-ad622f4d6c77 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:52.756650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7d13555b-cb4c-4878-af90-ad622f4d6c77 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:52.769073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7d13555b-cb4c-4878-af90-ad622f4d6c77 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:52.770962 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7d13555b-cb4c-4878-af90-ad622f4d6c77 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:52.790351 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7d13555b-cb4c-4878-af90-ad622f4d6c77 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.409850 Aug 31 11:07:52.800541 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 181/344] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:52 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:07:52.814192 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3d560a52-9135-41c5-964b-66571f19fc13 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:52.815025 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3d560a52-9135-41c5-964b-66571f19fc13 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:52.823114 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3d560a52-9135-41c5-964b-66571f19fc13 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:52.823770 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3d560a52-9135-41c5-964b-66571f19fc13 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:52.824366 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3d560a52-9135-41c5-964b-66571f19fc13 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:52.825288 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3d560a52-9135-41c5-964b-66571f19fc13 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:52.825843 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3d560a52-9135-41c5-964b-66571f19fc13 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:52.826546 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3d560a52-9135-41c5-964b-66571f19fc13 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:53.048789 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3d560a52-9135-41c5-964b-66571f19fc13 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:53.059330 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3d560a52-9135-41c5-964b-66571f19fc13 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 0.257391 Aug 31 11:07:53.060691 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 182/345] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:52 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:53.066205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-471c2fdd-9647-4880-9563-88ef3088ed7f req-a3d24265-c39a-4e10-917e-3ca915761998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ab2526-7363-4846-86d8-cb2fa6705c76", "name": "network-vif-plugged", "status": "completed", "tag": "7b6fd60a-b00d-41c8-912f-b319241ebfad"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:53.082732 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-471c2fdd-9647-4880-9563-88ef3088ed7f req-a3d24265-c39a-4e10-917e-3ca915761998 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:53.083930 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-471c2fdd-9647-4880-9563-88ef3088ed7f req-a3d24265-c39a-4e10-917e-3ca915761998 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:53.085072 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-471c2fdd-9647-4880-9563-88ef3088ed7f req-a3d24265-c39a-4e10-917e-3ca915761998 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:53.090920 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:53.114306 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-471c2fdd-9647-4880-9563-88ef3088ed7f req-a3d24265-c39a-4e10-917e-3ca915761998 service nova] Creating event network-vif-plugged:7b6fd60a-b00d-41c8-912f-b319241ebfad for instance f1ab2526-7363-4846-86d8-cb2fa6705c76 on hv-cinder-85535 Aug 31 11:07:53.122010 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-471c2fdd-9647-4880-9563-88ef3088ed7f req-a3d24265-c39a-4e10-917e-3ca915761998 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059633 Aug 31 11:07:53.122755 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 183/346] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:53.128838 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:53.129614 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:53.139339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:53.139846 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:53.140373 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:53.141184 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:53.141657 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:53.142126 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:53.189216 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:53.190025 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:53.190502 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:53.191002 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lazy-loading 'fault' on Instance uuid 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:07:53.319127 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce412ceead11449aa5969320405e9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c48ea6637c49d7b7cec6e805c4be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:53.332399 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-656b8a8f-dbc8-4736-a7c6-a3e36f1cc9a6 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 200 len: 1305 microversion: 2.1 time: 0.208086 Aug 31 11:07:53.349545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 184/347] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:53 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 1305 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:53.362451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9d361689-478a-42dc-93f3-9753e8a645a0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:53.363569 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9d361689-478a-42dc-93f3-9753e8a645a0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:53.373935 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9d361689-478a-42dc-93f3-9753e8a645a0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:53.374888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9d361689-478a-42dc-93f3-9753e8a645a0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:53.375635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9d361689-478a-42dc-93f3-9753e8a645a0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:53.376779 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9d361689-478a-42dc-93f3-9753e8a645a0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:53.377596 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9d361689-478a-42dc-93f3-9753e8a645a0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:53.378133 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9d361689-478a-42dc-93f3-9753e8a645a0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:53.673796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9d361689-478a-42dc-93f3-9753e8a645a0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:53.685898 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9d361689-478a-42dc-93f3-9753e8a645a0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1367 microversion: 2.1 time: 0.330236 Aug 31 11:07:53.687207 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 185/348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:53 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:53.703265 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-36dfe787-5f79-4874-b94e-a5c519b2eb41 req-c36ab597-fca2-4a0b-9ff4-7972d36a1992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd", "name": "network-vif-deleted", "tag": "9b78d397-c172-459c-b216-ef5a6b700eb2"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:53.713533 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-36dfe787-5f79-4874-b94e-a5c519b2eb41 req-c36ab597-fca2-4a0b-9ff4-7972d36a1992 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:53.714018 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-36dfe787-5f79-4874-b94e-a5c519b2eb41 req-c36ab597-fca2-4a0b-9ff4-7972d36a1992 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:53.714448 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-36dfe787-5f79-4874-b94e-a5c519b2eb41 req-c36ab597-fca2-4a0b-9ff4-7972d36a1992 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:53.748140 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-36dfe787-5f79-4874-b94e-a5c519b2eb41 req-c36ab597-fca2-4a0b-9ff4-7972d36a1992 service nova] Creating event network-vif-deleted:9b78d397-c172-459c-b216-ef5a6b700eb2 for instance 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd on hv-cinder-85535 Aug 31 11:07:53.765892 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-36dfe787-5f79-4874-b94e-a5c519b2eb41 req-c36ab597-fca2-4a0b-9ff4-7972d36a1992 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077198 Aug 31 11:07:53.767032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 186/349] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:53.823558 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8361ac06-d2ce-4892-9af9-6c2e8cab2a46 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:53.824378 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8361ac06-d2ce-4892-9af9-6c2e8cab2a46 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:53.831151 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8361ac06-d2ce-4892-9af9-6c2e8cab2a46 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:53.831724 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8361ac06-d2ce-4892-9af9-6c2e8cab2a46 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:53.832402 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8361ac06-d2ce-4892-9af9-6c2e8cab2a46 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:53.833253 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8361ac06-d2ce-4892-9af9-6c2e8cab2a46 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:53.833853 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8361ac06-d2ce-4892-9af9-6c2e8cab2a46 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:53.834424 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8361ac06-d2ce-4892-9af9-6c2e8cab2a46 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:54.136628 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8361ac06-d2ce-4892-9af9-6c2e8cab2a46 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:54.151247 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8361ac06-d2ce-4892-9af9-6c2e8cab2a46 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:54.155570 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8361ac06-d2ce-4892-9af9-6c2e8cab2a46 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:54.156939 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8361ac06-d2ce-4892-9af9-6c2e8cab2a46 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.338274 Aug 31 11:07:54.172218 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 187/350] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:53 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:54.183494 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b4d6b17a-9b22-458e-9009-8f386fd3980d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:54.184414 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b4d6b17a-9b22-458e-9009-8f386fd3980d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:54.196034 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4d6b17a-9b22-458e-9009-8f386fd3980d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:54.196665 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4d6b17a-9b22-458e-9009-8f386fd3980d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:54.197440 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4d6b17a-9b22-458e-9009-8f386fd3980d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:54.199603 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4d6b17a-9b22-458e-9009-8f386fd3980d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:54.200200 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4d6b17a-9b22-458e-9009-8f386fd3980d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:54.200705 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4d6b17a-9b22-458e-9009-8f386fd3980d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:54.442901 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b4d6b17a-9b22-458e-9009-8f386fd3980d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:54.454145 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b4d6b17a-9b22-458e-9009-8f386fd3980d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 0.280348 Aug 31 11:07:54.455306 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 188/351] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:54 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:54.460238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e6437a90-4fb0-48d3-8912-c81de37060d0 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:54.461438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e6437a90-4fb0-48d3-8912-c81de37060d0 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] [instance: 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:54.468437 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e6437a90-4fb0-48d3-8912-c81de37060d0 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:54.469213 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e6437a90-4fb0-48d3-8912-c81de37060d0 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:54.470693 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e6437a90-4fb0-48d3-8912-c81de37060d0 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:54.472619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e6437a90-4fb0-48d3-8912-c81de37060d0 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:54.473291 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e6437a90-4fb0-48d3-8912-c81de37060d0 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:54.473884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e6437a90-4fb0-48d3-8912-c81de37060d0 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:54.502489 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-e6437a90-4fb0-48d3-8912-c81de37060d0 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] HTTP exception thrown: Instance 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd could not be found. Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e6437a90-4fb0-48d3-8912-c81de37060d0 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Request method failure captured: Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd HTTP/1.1 Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0DcStNhfqv1x_slh-bC8F0FfIKZipXSR1CLrepAgIU0J02ZkEKiohneSIHMjnNwi4MXniYRE395ODkjQ0nCFJr-g0OgPFY9dMf_PkVhpMcEIUcyeGzBGORhrJUGwqEoMeO60nNWWr_RMMi-whhmuB5bNhZillJMfGUiZp7Njo5P1zI Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 48c48ea6637c49d7b7cec6e805c4be87 Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-VolumesNegativeTest-35237544 Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:07:54.504903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:07:54.506447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48c48ea6637c49d7b7cec6e805c4be87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48c48ea6637c49d7b7cec6e805c4be87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48c48ea6637c49d7b7cec6e805c4be87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48c48ea6637c49d7b7cec6e805c4be87"}]}] Aug 31 11:07:54.506447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-VolumesNegativeTest-35237544 Aug 31 11:07:54.506447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 48c48ea6637c49d7b7cec6e805c4be87 Aug 31 11:07:54.506447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-VolumesNegativeTest-35237544 Aug 31 11:07:54.506447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-VolumesNegativeTest-35237544-project Aug 31 11:07:54.506447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:07:54.506447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:07:54.506447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: ce412ceead11449aa5969320405e9f3a Aug 31 11:07:54.506447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-VolumesNegativeTest-35237544-project Aug 31 11:07:54.506447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:07:54.506447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd could not be found. Aug 31 11:07:54.506447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd'} Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd could not be found. Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:07:54.507357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd could not be found. Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd could not be found. Aug 31 11:07:54.510641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:07:54.512032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e6437a90-4fb0-48d3-8912-c81de37060d0 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] Returning 404 to user: Instance 208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:07:54.512141 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e6437a90-4fb0-48d3-8912-c81de37060d0 tempest-VolumesNegativeTest-35237544 tempest-VolumesNegativeTest-35237544-project] 10.222.0.20 "GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd" status: 404 len: 111 microversion: 2.1 time: 0.053862 Aug 31 11:07:54.513406 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 189/352] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:54 2022] GET /compute/v2.1/servers/208a7e5d-3d0e-4ac4-95c0-88d42dc37ecd => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:07:54.709966 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-26bd423e-0052-46a5-9e57-1408dff146c8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:54.712190 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-26bd423e-0052-46a5-9e57-1408dff146c8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:54.721167 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-26bd423e-0052-46a5-9e57-1408dff146c8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:54.725133 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-26bd423e-0052-46a5-9e57-1408dff146c8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:54.727566 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-26bd423e-0052-46a5-9e57-1408dff146c8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:54.729359 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-26bd423e-0052-46a5-9e57-1408dff146c8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:54.729936 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-26bd423e-0052-46a5-9e57-1408dff146c8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:54.730950 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-26bd423e-0052-46a5-9e57-1408dff146c8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:54.956061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-26bd423e-0052-46a5-9e57-1408dff146c8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:54.965985 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-26bd423e-0052-46a5-9e57-1408dff146c8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1367 microversion: 2.1 time: 0.262031 Aug 31 11:07:54.966742 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 190/353] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:54 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:55.189567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-830a6fd9-a3ee-4e94-9db0-1427660e8b31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:55.190431 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-830a6fd9-a3ee-4e94-9db0-1427660e8b31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:55.199211 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-830a6fd9-a3ee-4e94-9db0-1427660e8b31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:55.199795 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-830a6fd9-a3ee-4e94-9db0-1427660e8b31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:55.200890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-830a6fd9-a3ee-4e94-9db0-1427660e8b31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:55.202204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-830a6fd9-a3ee-4e94-9db0-1427660e8b31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:55.204958 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-830a6fd9-a3ee-4e94-9db0-1427660e8b31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:55.205457 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-830a6fd9-a3ee-4e94-9db0-1427660e8b31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:55.373628 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-830a6fd9-a3ee-4e94-9db0-1427660e8b31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:55.384595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-830a6fd9-a3ee-4e94-9db0-1427660e8b31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:55.386174 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-830a6fd9-a3ee-4e94-9db0-1427660e8b31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:55.387428 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-830a6fd9-a3ee-4e94-9db0-1427660e8b31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.205913 Aug 31 11:07:55.403502 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 191/354] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:55 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:55.480371 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-21206055-bde3-4426-850c-22b7f6e04087 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:55.480906 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-21206055-bde3-4426-850c-22b7f6e04087 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:55.488075 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-21206055-bde3-4426-850c-22b7f6e04087 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:55.488662 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-21206055-bde3-4426-850c-22b7f6e04087 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:55.489342 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-21206055-bde3-4426-850c-22b7f6e04087 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:55.490231 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-21206055-bde3-4426-850c-22b7f6e04087 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:55.490770 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-21206055-bde3-4426-850c-22b7f6e04087 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:55.491291 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-21206055-bde3-4426-850c-22b7f6e04087 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:55.666373 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-21206055-bde3-4426-850c-22b7f6e04087 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:55.683420 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-21206055-bde3-4426-850c-22b7f6e04087 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1358 microversion: 2.1 time: 0.206851 Aug 31 11:07:55.704309 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 192/355] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:55 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:55.949472 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-6463dc65-707d-4e0c-a5f6-fe05626311db req-63d3e265-1551-4545-a107-9ed82a26263f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962f8405-fd3a-4f34-92de-a437bdcb7845", "name": "network-vif-plugged", "status": "completed", "tag": "e7ff85c2-9219-4680-b3cd-1a1d113ea478"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:55.968482 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=8 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:55.972716 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-6463dc65-707d-4e0c-a5f6-fe05626311db req-63d3e265-1551-4545-a107-9ed82a26263f service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:55.973341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-6463dc65-707d-4e0c-a5f6-fe05626311db req-63d3e265-1551-4545-a107-9ed82a26263f service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:55.973894 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-6463dc65-707d-4e0c-a5f6-fe05626311db req-63d3e265-1551-4545-a107-9ed82a26263f service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:56.006007 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-6463dc65-707d-4e0c-a5f6-fe05626311db req-63d3e265-1551-4545-a107-9ed82a26263f service nova] Creating event network-vif-plugged:e7ff85c2-9219-4680-b3cd-1a1d113ea478 for instance 962f8405-fd3a-4f34-92de-a437bdcb7845 on hv-cinder-85535 Aug 31 11:07:56.011944 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-6463dc65-707d-4e0c-a5f6-fe05626311db req-63d3e265-1551-4545-a107-9ed82a26263f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067689 Aug 31 11:07:56.013489 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 193/356] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:07:56.020361 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-42932107-f454-4f4f-a90e-d29041dd8fe5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:56.021228 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-42932107-f454-4f4f-a90e-d29041dd8fe5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:56.029052 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-42932107-f454-4f4f-a90e-d29041dd8fe5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:56.029841 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-42932107-f454-4f4f-a90e-d29041dd8fe5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:56.030708 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-42932107-f454-4f4f-a90e-d29041dd8fe5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:56.031680 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-42932107-f454-4f4f-a90e-d29041dd8fe5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:56.032337 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-42932107-f454-4f4f-a90e-d29041dd8fe5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:56.032930 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-42932107-f454-4f4f-a90e-d29041dd8fe5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:56.258746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-42932107-f454-4f4f-a90e-d29041dd8fe5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:56.267796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-42932107-f454-4f4f-a90e-d29041dd8fe5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1367 microversion: 2.1 time: 0.252916 Aug 31 11:07:56.282093 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 194/357] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:56 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:56.411406 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8dc162ab-675b-4980-81e2-c01f2ff3ad70 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:56.412137 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8dc162ab-675b-4980-81e2-c01f2ff3ad70 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:56.420530 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8dc162ab-675b-4980-81e2-c01f2ff3ad70 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:56.420950 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8dc162ab-675b-4980-81e2-c01f2ff3ad70 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:56.421390 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8dc162ab-675b-4980-81e2-c01f2ff3ad70 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:56.422138 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8dc162ab-675b-4980-81e2-c01f2ff3ad70 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:56.422617 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8dc162ab-675b-4980-81e2-c01f2ff3ad70 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:56.423080 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8dc162ab-675b-4980-81e2-c01f2ff3ad70 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:56.610018 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8dc162ab-675b-4980-81e2-c01f2ff3ad70 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:56.619496 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8dc162ab-675b-4980-81e2-c01f2ff3ad70 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:56.621824 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8dc162ab-675b-4980-81e2-c01f2ff3ad70 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:56.623018 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8dc162ab-675b-4980-81e2-c01f2ff3ad70 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.216194 Aug 31 11:07:56.623673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 195/358] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:56 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:07:56.728315 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4601cd50-f73f-45f0-94e2-2a45e6eb04ef tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:56.729645 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4601cd50-f73f-45f0-94e2-2a45e6eb04ef tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:56.737344 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4601cd50-f73f-45f0-94e2-2a45e6eb04ef tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:56.737878 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4601cd50-f73f-45f0-94e2-2a45e6eb04ef tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:56.738273 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4601cd50-f73f-45f0-94e2-2a45e6eb04ef tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:56.739009 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4601cd50-f73f-45f0-94e2-2a45e6eb04ef tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:56.739465 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4601cd50-f73f-45f0-94e2-2a45e6eb04ef tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:56.739893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4601cd50-f73f-45f0-94e2-2a45e6eb04ef tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:56.916191 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4601cd50-f73f-45f0-94e2-2a45e6eb04ef tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:56.926355 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4601cd50-f73f-45f0-94e2-2a45e6eb04ef tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1547 microversion: 2.1 time: 0.205996 Aug 31 11:07:56.927177 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 196/359] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:56 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1547 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:56.948998 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0f56ae4d-0327-4448-9648-a030f502d061 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:56.949627 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-0f56ae4d-0327-4448-9648-a030f502d061 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:56.956574 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0f56ae4d-0327-4448-9648-a030f502d061 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:56.957079 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0f56ae4d-0327-4448-9648-a030f502d061 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:56.957505 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0f56ae4d-0327-4448-9648-a030f502d061 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:56.958214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0f56ae4d-0327-4448-9648-a030f502d061 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:56.958664 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0f56ae4d-0327-4448-9648-a030f502d061 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:56.959102 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0f56ae4d-0327-4448-9648-a030f502d061 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:57.128879 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0f56ae4d-0327-4448-9648-a030f502d061 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:57.139506 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0f56ae4d-0327-4448-9648-a030f502d061 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1547 microversion: 2.1 time: 0.194576 Aug 31 11:07:57.140535 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 197/360] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:56 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1547 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:57.162273 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6f9b3d37-b4c5-41df-bd5a-e64558c1702b tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:57.169624 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6f9b3d37-b4c5-41df-bd5a-e64558c1702b tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:57.171134 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6f9b3d37-b4c5-41df-bd5a-e64558c1702b tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Searching by: {'deleted': False, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f'} {{(pid=120654) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 11:07:57.173563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:57.180756 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6f9b3d37-b4c5-41df-bd5a-e64558c1702b tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:57.181245 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6f9b3d37-b4c5-41df-bd5a-e64558c1702b tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:57.181805 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6f9b3d37-b4c5-41df-bd5a-e64558c1702b tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:57.182826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6f9b3d37-b4c5-41df-bd5a-e64558c1702b tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:57.183196 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6f9b3d37-b4c5-41df-bd5a-e64558c1702b tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:57.184155 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6f9b3d37-b4c5-41df-bd5a-e64558c1702b tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:57.309228 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.multi_cell_list [None req-6f9b3d37-b4c5-41df-bd5a-e64558c1702b tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120654) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 11:07:57.418628 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6f9b3d37-b4c5-41df-bd5a-e64558c1702b tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.260870 Aug 31 11:07:57.420109 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 198/361] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Aug 31 11:07:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:07:57.425476 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-cadaadd8-cf23-473a-948d-9af201d2a23e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:57.426320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-cadaadd8-cf23-473a-948d-9af201d2a23e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:57.433352 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cadaadd8-cf23-473a-948d-9af201d2a23e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:57.433829 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cadaadd8-cf23-473a-948d-9af201d2a23e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:57.434257 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cadaadd8-cf23-473a-948d-9af201d2a23e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:57.434949 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cadaadd8-cf23-473a-948d-9af201d2a23e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:57.435391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cadaadd8-cf23-473a-948d-9af201d2a23e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:57.435804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cadaadd8-cf23-473a-948d-9af201d2a23e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:57.607021 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-cadaadd8-cf23-473a-948d-9af201d2a23e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:57.617804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-cadaadd8-cf23-473a-948d-9af201d2a23e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1367 microversion: 2.1 time: 0.195152 Aug 31 11:07:57.630859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 199/362] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:57 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:57.630859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a30aecd3-d5f1-486e-a891-52989ab1926d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:57.630859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a30aecd3-d5f1-486e-a891-52989ab1926d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:57.634397 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a30aecd3-d5f1-486e-a891-52989ab1926d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:57.635002 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a30aecd3-d5f1-486e-a891-52989ab1926d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:57.635533 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a30aecd3-d5f1-486e-a891-52989ab1926d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:57.636361 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a30aecd3-d5f1-486e-a891-52989ab1926d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:57.636804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a30aecd3-d5f1-486e-a891-52989ab1926d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:57.637229 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a30aecd3-d5f1-486e-a891-52989ab1926d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:57.824767 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a30aecd3-d5f1-486e-a891-52989ab1926d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:57.838802 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a30aecd3-d5f1-486e-a891-52989ab1926d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1547 microversion: 2.1 time: 0.214421 Aug 31 11:07:57.839796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 200/363] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:57 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1547 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:57.846440 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3347bb4a-8660-4d3a-8458-2046d6025049 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:57.847378 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3347bb4a-8660-4d3a-8458-2046d6025049 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:57.856622 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3347bb4a-8660-4d3a-8458-2046d6025049 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:57.857826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3347bb4a-8660-4d3a-8458-2046d6025049 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:57.857954 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3347bb4a-8660-4d3a-8458-2046d6025049 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:57.858888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3347bb4a-8660-4d3a-8458-2046d6025049 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:57.859472 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3347bb4a-8660-4d3a-8458-2046d6025049 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:57.860093 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3347bb4a-8660-4d3a-8458-2046d6025049 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:58.037145 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3347bb4a-8660-4d3a-8458-2046d6025049 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:58.040148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=100 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:58.048357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3347bb4a-8660-4d3a-8458-2046d6025049 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:58.049958 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3347bb4a-8660-4d3a-8458-2046d6025049 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:58.051375 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3347bb4a-8660-4d3a-8458-2046d6025049 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.210089 Aug 31 11:07:58.051996 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 201/364] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:57 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:58.638109 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fd1315df-5f4a-45ae-b20d-4134849dbff4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:58.638791 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fd1315df-5f4a-45ae-b20d-4134849dbff4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:58.645112 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fd1315df-5f4a-45ae-b20d-4134849dbff4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:58.645603 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fd1315df-5f4a-45ae-b20d-4134849dbff4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:58.646040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fd1315df-5f4a-45ae-b20d-4134849dbff4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:58.646969 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fd1315df-5f4a-45ae-b20d-4134849dbff4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:58.647328 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fd1315df-5f4a-45ae-b20d-4134849dbff4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:58.647771 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fd1315df-5f4a-45ae-b20d-4134849dbff4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:58.808984 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fd1315df-5f4a-45ae-b20d-4134849dbff4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:58.817586 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fd1315df-5f4a-45ae-b20d-4134849dbff4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1555 microversion: 2.1 time: 0.183522 Aug 31 11:07:58.818222 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 202/365] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:58 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:07:58.839646 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-91690b34-ec8e-4667-acc3-a2288acd9b01 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:58.840176 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-91690b34-ec8e-4667-acc3-a2288acd9b01 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:58.848373 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-91690b34-ec8e-4667-acc3-a2288acd9b01 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:58.848980 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-91690b34-ec8e-4667-acc3-a2288acd9b01 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:58.849426 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-91690b34-ec8e-4667-acc3-a2288acd9b01 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:58.850342 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-91690b34-ec8e-4667-acc3-a2288acd9b01 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:58.850892 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-91690b34-ec8e-4667-acc3-a2288acd9b01 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:58.852073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-91690b34-ec8e-4667-acc3-a2288acd9b01 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:58.962857 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-91690b34-ec8e-4667-acc3-a2288acd9b01 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127629 Aug 31 11:07:58.964370 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 203/366] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 11:07:58 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:07:59.086661 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-66473eed-7e41-488a-af46-a1b739302b80 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:59.088325 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-66473eed-7e41-488a-af46-a1b739302b80 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:59.114836 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66473eed-7e41-488a-af46-a1b739302b80 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:59.116121 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66473eed-7e41-488a-af46-a1b739302b80 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:59.117254 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66473eed-7e41-488a-af46-a1b739302b80 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:59.118882 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66473eed-7e41-488a-af46-a1b739302b80 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:59.120365 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66473eed-7e41-488a-af46-a1b739302b80 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:59.122832 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66473eed-7e41-488a-af46-a1b739302b80 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:59.422821 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-66473eed-7e41-488a-af46-a1b739302b80 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:59.433150 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-66473eed-7e41-488a-af46-a1b739302b80 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:59.437653 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-66473eed-7e41-488a-af46-a1b739302b80 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:59.439234 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-66473eed-7e41-488a-af46-a1b739302b80 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.363563 Aug 31 11:07:59.440389 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 204/367] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:07:59 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:07:59.703993 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-df98dc7e-b870-4a3c-9603-1a54bf800660 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cd4b966-83c1-4411-96f8-f87bc34fc543"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:59.706467 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-df98dc7e-b870-4a3c-9603-1a54bf800660 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:59.716208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-df98dc7e-b870-4a3c-9603-1a54bf800660 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:59.717071 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-df98dc7e-b870-4a3c-9603-1a54bf800660 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:59.717807 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-df98dc7e-b870-4a3c-9603-1a54bf800660 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:59.718709 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-df98dc7e-b870-4a3c-9603-1a54bf800660 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:59.719178 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-df98dc7e-b870-4a3c-9603-1a54bf800660 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:59.719593 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-df98dc7e-b870-4a3c-9603-1a54bf800660 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:00.142029 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-df98dc7e-b870-4a3c-9603-1a54bf800660 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "POST /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.441535 Aug 31 11:08:00.144191 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 205/368] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:07:59 2022] POST /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments => generated 194 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:08:00.471794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8ed580db-d6d5-42a7-9ff1-c45ab4539eaa tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:00.472845 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8ed580db-d6d5-42a7-9ff1-c45ab4539eaa tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:00.489464 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ed580db-d6d5-42a7-9ff1-c45ab4539eaa tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:00.490522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ed580db-d6d5-42a7-9ff1-c45ab4539eaa tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:00.491351 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ed580db-d6d5-42a7-9ff1-c45ab4539eaa tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:00.493176 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ed580db-d6d5-42a7-9ff1-c45ab4539eaa tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:00.494154 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ed580db-d6d5-42a7-9ff1-c45ab4539eaa tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:00.494998 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ed580db-d6d5-42a7-9ff1-c45ab4539eaa tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:00.691754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8ed580db-d6d5-42a7-9ff1-c45ab4539eaa tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:00.703681 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8ed580db-d6d5-42a7-9ff1-c45ab4539eaa tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:00.705537 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8ed580db-d6d5-42a7-9ff1-c45ab4539eaa tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:00.707713 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8ed580db-d6d5-42a7-9ff1-c45ab4539eaa tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.248248 Aug 31 11:08:00.709150 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 206/369] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:00 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:08:01.073339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-74091405-ef17-4649-82f8-4e183a33f0a1 req-afd47950-a631-4c52-bd83-b2abb6293d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962f8405-fd3a-4f34-92de-a437bdcb7845", "tag": "e7ff85c2-9219-4680-b3cd-1a1d113ea478"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:01.083326 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-74091405-ef17-4649-82f8-4e183a33f0a1 req-afd47950-a631-4c52-bd83-b2abb6293d43 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:01.083811 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-74091405-ef17-4649-82f8-4e183a33f0a1 req-afd47950-a631-4c52-bd83-b2abb6293d43 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:01.084356 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-74091405-ef17-4649-82f8-4e183a33f0a1 req-afd47950-a631-4c52-bd83-b2abb6293d43 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:01.113891 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-74091405-ef17-4649-82f8-4e183a33f0a1 req-afd47950-a631-4c52-bd83-b2abb6293d43 service nova] Creating event network-changed:e7ff85c2-9219-4680-b3cd-1a1d113ea478 for instance 962f8405-fd3a-4f34-92de-a437bdcb7845 on hv-cinder-85535 Aug 31 11:08:01.119760 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-74091405-ef17-4649-82f8-4e183a33f0a1 req-afd47950-a631-4c52-bd83-b2abb6293d43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052324 Aug 31 11:08:01.120975 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 207/370] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:08:01.742889 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-697b13b2-0b49-4a15-bb1f-0459effe9d9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:01.747874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-697b13b2-0b49-4a15-bb1f-0459effe9d9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:01.767703 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-697b13b2-0b49-4a15-bb1f-0459effe9d9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:01.768779 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-697b13b2-0b49-4a15-bb1f-0459effe9d9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:01.769456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-697b13b2-0b49-4a15-bb1f-0459effe9d9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:01.770658 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-697b13b2-0b49-4a15-bb1f-0459effe9d9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:01.772108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-697b13b2-0b49-4a15-bb1f-0459effe9d9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:01.773505 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-697b13b2-0b49-4a15-bb1f-0459effe9d9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:01.995219 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-697b13b2-0b49-4a15-bb1f-0459effe9d9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:02.002854 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=55 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:02.010279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-697b13b2-0b49-4a15-bb1f-0459effe9d9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:02.012648 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-697b13b2-0b49-4a15-bb1f-0459effe9d9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:02.014030 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-697b13b2-0b49-4a15-bb1f-0459effe9d9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.283221 Aug 31 11:08:02.028777 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 208/371] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:01 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:02.139597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=11 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:02.697095 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.network.neutron [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] validate_networks() for [('5115a138-f5d9-41a5-9c7a-63c215e1254a', None, None, None, None, None)] {{(pid=120655) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:08:03.045354 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e0a2d98f-0ccd-466c-ae6b-68ca4ecf8583 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:03.046002 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e0a2d98f-0ccd-466c-ae6b-68ca4ecf8583 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:03.059014 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0a2d98f-0ccd-466c-ae6b-68ca4ecf8583 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:03.059833 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0a2d98f-0ccd-466c-ae6b-68ca4ecf8583 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:03.060489 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0a2d98f-0ccd-466c-ae6b-68ca4ecf8583 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:03.065504 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0a2d98f-0ccd-466c-ae6b-68ca4ecf8583 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:03.065990 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0a2d98f-0ccd-466c-ae6b-68ca4ecf8583 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:03.066449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0a2d98f-0ccd-466c-ae6b-68ca4ecf8583 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:03.298950 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Flavor limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:08:03.300434 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Image limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:08:03.301510 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Flavor pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:08:03.302407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Image pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:08:03.305271 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:08:03.328441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:03.329585 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:03.332921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:03.335383 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:03.336353 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:03.337474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:03.368424 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e0a2d98f-0ccd-466c-ae6b-68ca4ecf8583 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:03.384242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e0a2d98f-0ccd-466c-ae6b-68ca4ecf8583 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:03.384590 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Getting quotas for project 9ceec51e430e4a00b407068a2243be63. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:08:03.387421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e0a2d98f-0ccd-466c-ae6b-68ca4ecf8583 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:03.390048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e0a2d98f-0ccd-466c-ae6b-68ca4ecf8583 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.348721 Aug 31 11:08:03.393035 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Getting quotas for user 19643be9952649aba81e61d5d55290c4 and project 9ceec51e430e4a00b407068a2243be63. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:08:03.397134 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 209/372] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:03 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:08:03.424589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Going to run 1 instances... {{(pid=120655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:08:03.428910 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:08:03.557858 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d55a36b1-9c55-4471-bc2c-88e5c584562c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 11.494073 Aug 31 11:08:03.559285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 164/373] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:07:52 2022] POST /compute/v2.1/servers => generated 408 bytes in 11502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:08:03.587037 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-29c81fb5-0c6b-45f0-b0a6-0f20b8a3d9f6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:03.588205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-29c81fb5-0c6b-45f0-b0a6-0f20b8a3d9f6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:03.737970 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-29c81fb5-0c6b-45f0-b0a6-0f20b8a3d9f6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:03.755234 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-29c81fb5-0c6b-45f0-b0a6-0f20b8a3d9f6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1245 microversion: 2.1 time: 0.182445 Aug 31 11:08:03.760085 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 210/374] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:03 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1245 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:04.427851 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-10938717-c236-49d6-84ff-902cd151e723 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:04.429082 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-10938717-c236-49d6-84ff-902cd151e723 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:04.441110 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10938717-c236-49d6-84ff-902cd151e723 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:04.442140 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10938717-c236-49d6-84ff-902cd151e723 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:04.443070 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10938717-c236-49d6-84ff-902cd151e723 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:04.444646 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10938717-c236-49d6-84ff-902cd151e723 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:04.446296 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10938717-c236-49d6-84ff-902cd151e723 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:04.447136 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10938717-c236-49d6-84ff-902cd151e723 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:04.778438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-dd84c461-d3ba-41fe-b278-0bd99514807b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:04.779127 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-dd84c461-d3ba-41fe-b278-0bd99514807b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:04.802606 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dd84c461-d3ba-41fe-b278-0bd99514807b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:04.806694 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dd84c461-d3ba-41fe-b278-0bd99514807b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:04.810899 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dd84c461-d3ba-41fe-b278-0bd99514807b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:04.812225 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dd84c461-d3ba-41fe-b278-0bd99514807b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:04.813171 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dd84c461-d3ba-41fe-b278-0bd99514807b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:04.813768 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dd84c461-d3ba-41fe-b278-0bd99514807b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:04.825850 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-10938717-c236-49d6-84ff-902cd151e723 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:04.840884 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-10938717-c236-49d6-84ff-902cd151e723 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:04.843202 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-10938717-c236-49d6-84ff-902cd151e723 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:04.847381 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-10938717-c236-49d6-84ff-902cd151e723 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.426955 Aug 31 11:08:04.847959 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 165/375] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:04 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:04.925336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-dd84c461-d3ba-41fe-b278-0bd99514807b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:04.936612 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-dd84c461-d3ba-41fe-b278-0bd99514807b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1297 microversion: 2.1 time: 0.162661 Aug 31 11:08:04.948135 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 211/376] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:04 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1297 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:05.875276 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6bc22960-280e-4ba9-a1ac-2d97de8fd3a2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:05.875886 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6bc22960-280e-4ba9-a1ac-2d97de8fd3a2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:05.889276 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bc22960-280e-4ba9-a1ac-2d97de8fd3a2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:05.889911 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bc22960-280e-4ba9-a1ac-2d97de8fd3a2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:05.890346 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bc22960-280e-4ba9-a1ac-2d97de8fd3a2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:05.891042 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bc22960-280e-4ba9-a1ac-2d97de8fd3a2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:05.891660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bc22960-280e-4ba9-a1ac-2d97de8fd3a2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:05.892262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bc22960-280e-4ba9-a1ac-2d97de8fd3a2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:05.963858 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7b2d9251-0713-4b46-8dc0-33028d0be359 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:05.968827 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7b2d9251-0713-4b46-8dc0-33028d0be359 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:05.985732 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7b2d9251-0713-4b46-8dc0-33028d0be359 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:05.986292 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7b2d9251-0713-4b46-8dc0-33028d0be359 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:05.986738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7b2d9251-0713-4b46-8dc0-33028d0be359 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:05.987469 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7b2d9251-0713-4b46-8dc0-33028d0be359 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:05.987923 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7b2d9251-0713-4b46-8dc0-33028d0be359 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:05.988373 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7b2d9251-0713-4b46-8dc0-33028d0be359 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:06.097718 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7b2d9251-0713-4b46-8dc0-33028d0be359 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:06.108377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7b2d9251-0713-4b46-8dc0-33028d0be359 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1303 microversion: 2.1 time: 0.150631 Aug 31 11:08:06.113525 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 212/377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:05 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1303 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:06.243083 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6bc22960-280e-4ba9-a1ac-2d97de8fd3a2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:06.252917 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6bc22960-280e-4ba9-a1ac-2d97de8fd3a2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:06.255289 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6bc22960-280e-4ba9-a1ac-2d97de8fd3a2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:06.257726 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6bc22960-280e-4ba9-a1ac-2d97de8fd3a2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.385971 Aug 31 11:08:06.273230 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 166/378] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:05 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:07.139021 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-21647bb8-e072-4c05-84b5-b46467964b91 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:07.140361 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-21647bb8-e072-4c05-84b5-b46467964b91 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:07.169798 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-21647bb8-e072-4c05-84b5-b46467964b91 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:07.171094 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-21647bb8-e072-4c05-84b5-b46467964b91 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:07.172874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-21647bb8-e072-4c05-84b5-b46467964b91 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:07.180498 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-21647bb8-e072-4c05-84b5-b46467964b91 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:07.183745 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-21647bb8-e072-4c05-84b5-b46467964b91 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:07.186115 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-21647bb8-e072-4c05-84b5-b46467964b91 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:07.283302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-705d6cd2-605d-458b-a643-e6337fb94894 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:07.283895 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:07.284036 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-705d6cd2-605d-458b-a643-e6337fb94894 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:07.295603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-705d6cd2-605d-458b-a643-e6337fb94894 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:07.311725 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-705d6cd2-605d-458b-a643-e6337fb94894 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:07.313829 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-705d6cd2-605d-458b-a643-e6337fb94894 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:07.314613 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-705d6cd2-605d-458b-a643-e6337fb94894 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:07.315084 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-705d6cd2-605d-458b-a643-e6337fb94894 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:07.318496 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-705d6cd2-605d-458b-a643-e6337fb94894 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:07.343322 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-21647bb8-e072-4c05-84b5-b46467964b91 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:07.362856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-21647bb8-e072-4c05-84b5-b46467964b91 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1303 microversion: 2.1 time: 0.234533 Aug 31 11:08:07.363444 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 213/379] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:07 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:07.620434 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-705d6cd2-605d-458b-a643-e6337fb94894 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:07.630336 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-705d6cd2-605d-458b-a643-e6337fb94894 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:07.632831 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-705d6cd2-605d-458b-a643-e6337fb94894 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:07.634972 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-705d6cd2-605d-458b-a643-e6337fb94894 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.355664 Aug 31 11:08:07.653368 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 167/380] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:07 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:08:08.300270 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8dfa73e4-1b02-4169-bdef-132d3e9aac8e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:08.301567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8dfa73e4-1b02-4169-bdef-132d3e9aac8e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:08.308898 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8dfa73e4-1b02-4169-bdef-132d3e9aac8e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:08.309794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8dfa73e4-1b02-4169-bdef-132d3e9aac8e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:08.310383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8dfa73e4-1b02-4169-bdef-132d3e9aac8e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:08.311242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8dfa73e4-1b02-4169-bdef-132d3e9aac8e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:08.311859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8dfa73e4-1b02-4169-bdef-132d3e9aac8e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:08.312559 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8dfa73e4-1b02-4169-bdef-132d3e9aac8e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:08.388464 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-61a0bc4e-db90-40c4-802d-ebbf3b5db08b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:08.391472 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-61a0bc4e-db90-40c4-802d-ebbf3b5db08b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:08.403314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-61a0bc4e-db90-40c4-802d-ebbf3b5db08b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:08.404309 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-61a0bc4e-db90-40c4-802d-ebbf3b5db08b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:08.405340 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-61a0bc4e-db90-40c4-802d-ebbf3b5db08b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:08.406368 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-61a0bc4e-db90-40c4-802d-ebbf3b5db08b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:08.407026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-61a0bc4e-db90-40c4-802d-ebbf3b5db08b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:08.407692 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-61a0bc4e-db90-40c4-802d-ebbf3b5db08b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:08.573215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8dfa73e4-1b02-4169-bdef-132d3e9aac8e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:08.583774 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8dfa73e4-1b02-4169-bdef-132d3e9aac8e tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1593 microversion: 2.1 time: 0.295117 Aug 31 11:08:08.584796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 214/381] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:08 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1593 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:08:08.663102 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b3354f48-80a7-48a4-8b83-5f2ccf85c274 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:08.664049 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b3354f48-80a7-48a4-8b83-5f2ccf85c274 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:08.675103 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3354f48-80a7-48a4-8b83-5f2ccf85c274 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:08.675695 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3354f48-80a7-48a4-8b83-5f2ccf85c274 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:08.676445 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3354f48-80a7-48a4-8b83-5f2ccf85c274 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:08.676956 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3354f48-80a7-48a4-8b83-5f2ccf85c274 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:08.682186 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3354f48-80a7-48a4-8b83-5f2ccf85c274 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:08.684668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3354f48-80a7-48a4-8b83-5f2ccf85c274 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:08.696632 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-61a0bc4e-db90-40c4-802d-ebbf3b5db08b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:08.708496 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-61a0bc4e-db90-40c4-802d-ebbf3b5db08b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1370 microversion: 2.1 time: 0.325691 Aug 31 11:08:08.719220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 168/382] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:08 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1370 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:08:08.966812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b3354f48-80a7-48a4-8b83-5f2ccf85c274 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:08.981717 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b3354f48-80a7-48a4-8b83-5f2ccf85c274 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:08.983468 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b3354f48-80a7-48a4-8b83-5f2ccf85c274 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:08.984977 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b3354f48-80a7-48a4-8b83-5f2ccf85c274 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.326040 Aug 31 11:08:08.987129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 215/383] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:08 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:09.177799 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-5e6ce570-dc12-4043-9037-0f03f634462f req-7791822f-37b8-470a-b0e3-87505240fbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01be6c4-bf01-4970-87ca-7c8e3cf14524", "tag": "a567e33c-5895-4192-99c1-30a51a815ee5"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:09.203620 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5e6ce570-dc12-4043-9037-0f03f634462f req-7791822f-37b8-470a-b0e3-87505240fbd4 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:09.204439 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5e6ce570-dc12-4043-9037-0f03f634462f req-7791822f-37b8-470a-b0e3-87505240fbd4 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:09.206230 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5e6ce570-dc12-4043-9037-0f03f634462f req-7791822f-37b8-470a-b0e3-87505240fbd4 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:09.228169 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-888356218", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1858534218", "security_groups": [{"name": "tempest-secgroup-smoke-517143940"}], "networks": [{"uuid": "e978984c-cdb9-427e-bbc2-aca564268e00"}], "block_device_mapping_v2": [{"uuid": "d807b0bd-64ab-4721-af7f-ee48af6cfb75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:09.293325 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-5e6ce570-dc12-4043-9037-0f03f634462f req-7791822f-37b8-470a-b0e3-87505240fbd4 service nova] Creating event network-changed:a567e33c-5895-4192-99c1-30a51a815ee5 for instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 on hv-cinder-85535 Aug 31 11:08:09.314873 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-5e6ce570-dc12-4043-9037-0f03f634462f req-7791822f-37b8-470a-b0e3-87505240fbd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142324 Aug 31 11:08:09.320438 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 169/384] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:08:09.540845 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] validate_networks() for [('e978984c-cdb9-427e-bbc2-aca564268e00', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:08:09.731023 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a07dafe5-2a16-4a3f-b453-ca32b29aeef1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:09.732504 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a07dafe5-2a16-4a3f-b453-ca32b29aeef1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:09.742504 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a07dafe5-2a16-4a3f-b453-ca32b29aeef1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:09.746196 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a07dafe5-2a16-4a3f-b453-ca32b29aeef1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:09.746998 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a07dafe5-2a16-4a3f-b453-ca32b29aeef1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:09.748912 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a07dafe5-2a16-4a3f-b453-ca32b29aeef1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:09.749380 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a07dafe5-2a16-4a3f-b453-ca32b29aeef1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:09.749811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a07dafe5-2a16-4a3f-b453-ca32b29aeef1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:10.091865 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a07dafe5-2a16-4a3f-b453-ca32b29aeef1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:10.101490 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a07dafe5-2a16-4a3f-b453-ca32b29aeef1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1370 microversion: 2.1 time: 0.374882 Aug 31 11:08:10.106266 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 170/385] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:09 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1370 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:08:10.114974 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-48c5f7b8-7816-40f6-9b26-4168acc2a5fd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:10.119661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-48c5f7b8-7816-40f6-9b26-4168acc2a5fd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:10.137566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48c5f7b8-7816-40f6-9b26-4168acc2a5fd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:10.139026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48c5f7b8-7816-40f6-9b26-4168acc2a5fd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:10.139676 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48c5f7b8-7816-40f6-9b26-4168acc2a5fd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:10.140617 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48c5f7b8-7816-40f6-9b26-4168acc2a5fd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:10.141267 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48c5f7b8-7816-40f6-9b26-4168acc2a5fd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:10.142626 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48c5f7b8-7816-40f6-9b26-4168acc2a5fd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:10.417491 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-48c5f7b8-7816-40f6-9b26-4168acc2a5fd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:10.426517 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-48c5f7b8-7816-40f6-9b26-4168acc2a5fd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:10.428934 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-48c5f7b8-7816-40f6-9b26-4168acc2a5fd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:10.430540 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-48c5f7b8-7816-40f6-9b26-4168acc2a5fd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.322158 Aug 31 11:08:10.431662 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 171/386] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:10 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:10.743316 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:08:10.743834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:08:10.746433 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:08:10.747223 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:08:10.748190 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:08:10.760388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:10.761280 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:10.761871 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:10.762899 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:10.763523 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:10.764347 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:10.833936 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Getting quotas for project 42099ef23496441fab42f876b9e39efd. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:08:10.851442 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Getting quotas for user d8c0e96bc0584d8b9be73ae920bbb055 and project 42099ef23496441fab42f876b9e39efd. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:08:10.954710 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:08:10.960635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d807b0bd-64ab-4721-af7f-ee48af6cfb75',volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:08:11.129134 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-17a1f409-b909-4e65-a944-dbeb5fdff4b0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:11.129737 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-17a1f409-b909-4e65-a944-dbeb5fdff4b0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:11.140381 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-17a1f409-b909-4e65-a944-dbeb5fdff4b0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:11.142434 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-17a1f409-b909-4e65-a944-dbeb5fdff4b0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:11.143846 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-17a1f409-b909-4e65-a944-dbeb5fdff4b0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:11.144970 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-17a1f409-b909-4e65-a944-dbeb5fdff4b0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:11.147369 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-17a1f409-b909-4e65-a944-dbeb5fdff4b0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:11.149194 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-17a1f409-b909-4e65-a944-dbeb5fdff4b0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:11.275162 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-49c640ed-0de9-4ae3-aa1c-80aebe916c69 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.056212 Aug 31 11:08:11.275903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 216/387] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:08:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 11:08:11.312656 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-81cebb75-c267-402a-b620-6a9cafb3dc11 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:11.317039 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-81cebb75-c267-402a-b620-6a9cafb3dc11 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:11.383024 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-17a1f409-b909-4e65-a944-dbeb5fdff4b0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:11.393940 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-17a1f409-b909-4e65-a944-dbeb5fdff4b0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1370 microversion: 2.1 time: 0.267942 Aug 31 11:08:11.395445 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 172/388] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:11 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:11.457778 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-57a9ed0b-e564-4c0b-ae7d-6972ab8e5702 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:11.458479 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-57a9ed0b-e564-4c0b-ae7d-6972ab8e5702 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:11.470861 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57a9ed0b-e564-4c0b-ae7d-6972ab8e5702 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:11.471381 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57a9ed0b-e564-4c0b-ae7d-6972ab8e5702 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:11.473291 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-81cebb75-c267-402a-b620-6a9cafb3dc11 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:11.473736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57a9ed0b-e564-4c0b-ae7d-6972ab8e5702 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:11.474540 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57a9ed0b-e564-4c0b-ae7d-6972ab8e5702 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:11.478104 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57a9ed0b-e564-4c0b-ae7d-6972ab8e5702 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:11.478794 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57a9ed0b-e564-4c0b-ae7d-6972ab8e5702 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:11.497142 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-81cebb75-c267-402a-b620-6a9cafb3dc11 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1088 microversion: 2.1 time: 0.211534 Aug 31 11:08:11.498690 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 217/389] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:11 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1088 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:11.937633 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-57a9ed0b-e564-4c0b-ae7d-6972ab8e5702 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:11.950595 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-57a9ed0b-e564-4c0b-ae7d-6972ab8e5702 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:11.956981 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-57a9ed0b-e564-4c0b-ae7d-6972ab8e5702 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:11.958416 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-57a9ed0b-e564-4c0b-ae7d-6972ab8e5702 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.507278 Aug 31 11:08:11.959153 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 173/390] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:11 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:12.449123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e190a114-6a85-48da-bef0-9a7255c92795 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:12.451416 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e190a114-6a85-48da-bef0-9a7255c92795 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:12.459325 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e190a114-6a85-48da-bef0-9a7255c92795 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:12.461776 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e190a114-6a85-48da-bef0-9a7255c92795 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:12.472226 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e190a114-6a85-48da-bef0-9a7255c92795 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:12.473419 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e190a114-6a85-48da-bef0-9a7255c92795 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:12.474084 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e190a114-6a85-48da-bef0-9a7255c92795 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:12.475119 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e190a114-6a85-48da-bef0-9a7255c92795 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:12.524537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-118a07ef-cfb2-4715-be6c-1d6462a640cd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:12.525360 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-118a07ef-cfb2-4715-be6c-1d6462a640cd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:12.557863 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-118a07ef-cfb2-4715-be6c-1d6462a640cd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:12.558366 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-118a07ef-cfb2-4715-be6c-1d6462a640cd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:12.558782 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-118a07ef-cfb2-4715-be6c-1d6462a640cd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:12.559516 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-118a07ef-cfb2-4715-be6c-1d6462a640cd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:12.559998 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-118a07ef-cfb2-4715-be6c-1d6462a640cd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:12.580158 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-118a07ef-cfb2-4715-be6c-1d6462a640cd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:12.726432 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-118a07ef-cfb2-4715-be6c-1d6462a640cd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:12.739493 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-118a07ef-cfb2-4715-be6c-1d6462a640cd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1130 microversion: 2.1 time: 0.219171 Aug 31 11:08:12.742783 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 174/391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:12 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1130 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:12.998039 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a0eef0ec-f0ca-4bbd-bd6d-f723c0d7e131 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:12.998681 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a0eef0ec-f0ca-4bbd-bd6d-f723c0d7e131 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:13.019104 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0eef0ec-f0ca-4bbd-bd6d-f723c0d7e131 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:13.019806 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0eef0ec-f0ca-4bbd-bd6d-f723c0d7e131 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:13.021027 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0eef0ec-f0ca-4bbd-bd6d-f723c0d7e131 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:13.023608 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0eef0ec-f0ca-4bbd-bd6d-f723c0d7e131 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:13.026768 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0eef0ec-f0ca-4bbd-bd6d-f723c0d7e131 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:13.027428 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0eef0ec-f0ca-4bbd-bd6d-f723c0d7e131 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:13.066220 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e190a114-6a85-48da-bef0-9a7255c92795 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:13.079528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e190a114-6a85-48da-bef0-9a7255c92795 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1370 microversion: 2.1 time: 0.637520 Aug 31 11:08:13.083385 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 218/392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:12 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1370 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:13.361208 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:13.391902 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a0eef0ec-f0ca-4bbd-bd6d-f723c0d7e131 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:13.402806 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a0eef0ec-f0ca-4bbd-bd6d-f723c0d7e131 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:13.404320 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a0eef0ec-f0ca-4bbd-bd6d-f723c0d7e131 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:13.405700 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a0eef0ec-f0ca-4bbd-bd6d-f723c0d7e131 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.422157 Aug 31 11:08:13.416978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 175/393] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:12 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:13.688655 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-9a6cd82f-8011-4d61-bb71-4d71ed7611a5 req-4f4ff225-45c3-4d13-9aaa-09d6ab251073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ab2526-7363-4846-86d8-cb2fa6705c76", "tag": "7b6fd60a-b00d-41c8-912f-b319241ebfad"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:13.723777 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-9a6cd82f-8011-4d61-bb71-4d71ed7611a5 req-4f4ff225-45c3-4d13-9aaa-09d6ab251073 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:13.726008 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-9a6cd82f-8011-4d61-bb71-4d71ed7611a5 req-4f4ff225-45c3-4d13-9aaa-09d6ab251073 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:13.726998 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-9a6cd82f-8011-4d61-bb71-4d71ed7611a5 req-4f4ff225-45c3-4d13-9aaa-09d6ab251073 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:13.750072 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-9a6cd82f-8011-4d61-bb71-4d71ed7611a5 req-4f4ff225-45c3-4d13-9aaa-09d6ab251073 service nova] Creating event network-changed:7b6fd60a-b00d-41c8-912f-b319241ebfad for instance f1ab2526-7363-4846-86d8-cb2fa6705c76 on hv-cinder-85535 Aug 31 11:08:13.759126 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-9a6cd82f-8011-4d61-bb71-4d71ed7611a5 req-4f4ff225-45c3-4d13-9aaa-09d6ab251073 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082841 Aug 31 11:08:13.760281 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 219/394] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:08:13.766864 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-44b2a8df-2a5a-496a-995c-17f79453ad39 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:13.770444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-44b2a8df-2a5a-496a-995c-17f79453ad39 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:13.775521 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=6 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:13.787362 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-44b2a8df-2a5a-496a-995c-17f79453ad39 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:13.791817 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-44b2a8df-2a5a-496a-995c-17f79453ad39 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:13.795068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-44b2a8df-2a5a-496a-995c-17f79453ad39 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:13.797538 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-44b2a8df-2a5a-496a-995c-17f79453ad39 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:13.798027 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-44b2a8df-2a5a-496a-995c-17f79453ad39 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:13.798467 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-44b2a8df-2a5a-496a-995c-17f79453ad39 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:13.980744 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-44b2a8df-2a5a-496a-995c-17f79453ad39 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:13.999878 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-44b2a8df-2a5a-496a-995c-17f79453ad39 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1186 microversion: 2.1 time: 0.241548 Aug 31 11:08:14.000872 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 176/395] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:13 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1186 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:08:14.110799 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-60c1751d-27a6-4fd2-bf84-2538c8e5f66b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:14.111483 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-60c1751d-27a6-4fd2-bf84-2538c8e5f66b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:14.122220 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-60c1751d-27a6-4fd2-bf84-2538c8e5f66b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:14.123089 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-60c1751d-27a6-4fd2-bf84-2538c8e5f66b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:14.123862 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-60c1751d-27a6-4fd2-bf84-2538c8e5f66b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:14.124985 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-60c1751d-27a6-4fd2-bf84-2538c8e5f66b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:14.125622 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-60c1751d-27a6-4fd2-bf84-2538c8e5f66b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:14.143464 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-60c1751d-27a6-4fd2-bf84-2538c8e5f66b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:14.434501 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-fe606742-5c63-4307-ad26-ef8a67f4d20f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:14.435471 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-fe606742-5c63-4307-ad26-ef8a67f4d20f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:14.478201 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-60c1751d-27a6-4fd2-bf84-2538c8e5f66b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:14.479010 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fe606742-5c63-4307-ad26-ef8a67f4d20f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:14.479919 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fe606742-5c63-4307-ad26-ef8a67f4d20f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:14.480584 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fe606742-5c63-4307-ad26-ef8a67f4d20f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:14.481525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fe606742-5c63-4307-ad26-ef8a67f4d20f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:14.487186 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fe606742-5c63-4307-ad26-ef8a67f4d20f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:14.487813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-fe606742-5c63-4307-ad26-ef8a67f4d20f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:14.490314 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-60c1751d-27a6-4fd2-bf84-2538c8e5f66b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1370 microversion: 2.1 time: 0.384129 Aug 31 11:08:14.497036 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 220/396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:14 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1370 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:14.504470 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-8afb0c2f-2525-4e9d-a0f4-4fad92633559 req-c0da9e06-b3aa-48e3-86b7-fb9b8bc39743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01be6c4-bf01-4970-87ca-7c8e3cf14524", "name": "network-vif-plugged", "status": "completed", "tag": "a567e33c-5895-4192-99c1-30a51a815ee5"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:14.551539 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-8afb0c2f-2525-4e9d-a0f4-4fad92633559 req-c0da9e06-b3aa-48e3-86b7-fb9b8bc39743 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:14.552782 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-8afb0c2f-2525-4e9d-a0f4-4fad92633559 req-c0da9e06-b3aa-48e3-86b7-fb9b8bc39743 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:14.555940 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-8afb0c2f-2525-4e9d-a0f4-4fad92633559 req-c0da9e06-b3aa-48e3-86b7-fb9b8bc39743 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:14.582422 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-8afb0c2f-2525-4e9d-a0f4-4fad92633559 req-c0da9e06-b3aa-48e3-86b7-fb9b8bc39743 service nova] Creating event network-vif-plugged:a567e33c-5895-4192-99c1-30a51a815ee5 for instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 on hv-cinder-85535 Aug 31 11:08:14.594201 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-8afb0c2f-2525-4e9d-a0f4-4fad92633559 req-c0da9e06-b3aa-48e3-86b7-fb9b8bc39743 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092670 Aug 31 11:08:14.595455 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 221/397] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:08:15.028434 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d8ba1a5f-7754-4818-92c9-88dd1180ff40 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:15.029945 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d8ba1a5f-7754-4818-92c9-88dd1180ff40 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:15.070633 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8ba1a5f-7754-4818-92c9-88dd1180ff40 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:15.071144 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8ba1a5f-7754-4818-92c9-88dd1180ff40 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:15.083684 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8ba1a5f-7754-4818-92c9-88dd1180ff40 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:15.087468 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8ba1a5f-7754-4818-92c9-88dd1180ff40 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:15.105913 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8ba1a5f-7754-4818-92c9-88dd1180ff40 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:15.109022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8ba1a5f-7754-4818-92c9-88dd1180ff40 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:15.226790 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:15.373633 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-fe606742-5c63-4307-ad26-ef8a67f4d20f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:15.390905 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-fe606742-5c63-4307-ad26-ef8a67f4d20f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:15.394968 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-fe606742-5c63-4307-ad26-ef8a67f4d20f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:15.399174 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-fe606742-5c63-4307-ad26-ef8a67f4d20f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.970707 Aug 31 11:08:15.420162 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 177/398] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:14 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:08:15.525150 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-47e6a40b-b485-444c-a200-c8c454bd220b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:15.527297 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-47e6a40b-b485-444c-a200-c8c454bd220b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:15.541103 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-47e6a40b-b485-444c-a200-c8c454bd220b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:15.541597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-47e6a40b-b485-444c-a200-c8c454bd220b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:15.542035 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-47e6a40b-b485-444c-a200-c8c454bd220b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:15.542735 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-47e6a40b-b485-444c-a200-c8c454bd220b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:15.543744 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d8ba1a5f-7754-4818-92c9-88dd1180ff40 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:15.550302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-47e6a40b-b485-444c-a200-c8c454bd220b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:15.550764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-47e6a40b-b485-444c-a200-c8c454bd220b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:15.561291 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d8ba1a5f-7754-4818-92c9-88dd1180ff40 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1204 microversion: 2.1 time: 0.539715 Aug 31 11:08:15.563933 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 222/399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:15 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1204 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:15.825691 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-47e6a40b-b485-444c-a200-c8c454bd220b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:15.837459 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-47e6a40b-b485-444c-a200-c8c454bd220b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1370 microversion: 2.1 time: 0.323476 Aug 31 11:08:15.849072 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 178/400] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:15 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1370 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:08:16.352974 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c1ab9949-6c54-41e5-85aa-ca91c4ca5738 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1001164686"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:16.353710 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c1ab9949-6c54-41e5-85aa-ca91c4ca5738 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:16.370782 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c1ab9949-6c54-41e5-85aa-ca91c4ca5738 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:16.371269 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c1ab9949-6c54-41e5-85aa-ca91c4ca5738 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:16.371925 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c1ab9949-6c54-41e5-85aa-ca91c4ca5738 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:16.372878 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c1ab9949-6c54-41e5-85aa-ca91c4ca5738 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:16.373332 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c1ab9949-6c54-41e5-85aa-ca91c4ca5738 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:16.373754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c1ab9949-6c54-41e5-85aa-ca91c4ca5738 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:16.425465 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c0ed48e1-cd12-4ae1-ab48-c10e072b610b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:16.426070 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c0ed48e1-cd12-4ae1-ab48-c10e072b610b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:16.433597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c0ed48e1-cd12-4ae1-ab48-c10e072b610b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:16.434083 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c0ed48e1-cd12-4ae1-ab48-c10e072b610b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:16.434518 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c0ed48e1-cd12-4ae1-ab48-c10e072b610b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:16.435413 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c0ed48e1-cd12-4ae1-ab48-c10e072b610b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:16.436089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c0ed48e1-cd12-4ae1-ab48-c10e072b610b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:16.436682 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c0ed48e1-cd12-4ae1-ab48-c10e072b610b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:16.630694 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.network.security_group_api [None req-c1ab9949-6c54-41e5-85aa-ca91c4ca5738 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Adding security group 84a53094-9dcd-4cc6-b8d1-2bfe89a4c57d to port 7b6fd60a-b00d-41c8-912f-b319241ebfad Aug 31 11:08:16.725323 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c0ed48e1-cd12-4ae1-ab48-c10e072b610b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:16.746885 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c0ed48e1-cd12-4ae1-ab48-c10e072b610b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:16.755074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c0ed48e1-cd12-4ae1-ab48-c10e072b610b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:16.758190 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c0ed48e1-cd12-4ae1-ab48-c10e072b610b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.336814 Aug 31 11:08:16.761405 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 179/401] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:16 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:08:16.766774 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e2f650df-9ebb-4b68-a754-3e6871b9dd77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:16.767957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e2f650df-9ebb-4b68-a754-3e6871b9dd77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:16.778113 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e2f650df-9ebb-4b68-a754-3e6871b9dd77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:16.778618 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e2f650df-9ebb-4b68-a754-3e6871b9dd77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:16.779062 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e2f650df-9ebb-4b68-a754-3e6871b9dd77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:16.779781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e2f650df-9ebb-4b68-a754-3e6871b9dd77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:16.780355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e2f650df-9ebb-4b68-a754-3e6871b9dd77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:16.781000 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e2f650df-9ebb-4b68-a754-3e6871b9dd77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:16.875914 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e2f650df-9ebb-4b68-a754-3e6871b9dd77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:16.885986 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e2f650df-9ebb-4b68-a754-3e6871b9dd77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1204 microversion: 2.1 time: 0.123244 Aug 31 11:08:16.886577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 180/402] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:16 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1204 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:16.891558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f53fcb1a-aedb-4b8f-ae3d-84da448d499a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:16.892406 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-f53fcb1a-aedb-4b8f-ae3d-84da448d499a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:16.900042 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f53fcb1a-aedb-4b8f-ae3d-84da448d499a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:16.901018 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f53fcb1a-aedb-4b8f-ae3d-84da448d499a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:16.901658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f53fcb1a-aedb-4b8f-ae3d-84da448d499a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:16.902686 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f53fcb1a-aedb-4b8f-ae3d-84da448d499a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:16.903326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f53fcb1a-aedb-4b8f-ae3d-84da448d499a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:16.903913 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f53fcb1a-aedb-4b8f-ae3d-84da448d499a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:17.137547 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-f53fcb1a-aedb-4b8f-ae3d-84da448d499a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:17.142352 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=100 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:17.152124 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-f53fcb1a-aedb-4b8f-ae3d-84da448d499a tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1370 microversion: 2.1 time: 0.264220 Aug 31 11:08:17.153178 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 181/403] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:16 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:17.160881 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c1ab9949-6c54-41e5-85aa-ca91c4ca5738 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "POST /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/action" status: 202 len: 0 microversion: 2.1 time: 0.813729 Aug 31 11:08:17.161487 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 223/404] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:08:16 2022] POST /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/action => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:08:17.180534 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-aa22cfed-ab6a-4293-bab9-f0a7d2fd45f3 req-b45f232c-1516-4c17-88fe-366a0dbb5adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ab2526-7363-4846-86d8-cb2fa6705c76", "tag": "7b6fd60a-b00d-41c8-912f-b319241ebfad"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:17.184186 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1eeb3e0a-05de-4f90-acd6-db9b156ee0b5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:17.185192 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-1eeb3e0a-05de-4f90-acd6-db9b156ee0b5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:17.204194 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1eeb3e0a-05de-4f90-acd6-db9b156ee0b5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:17.204791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1eeb3e0a-05de-4f90-acd6-db9b156ee0b5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:17.205321 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1eeb3e0a-05de-4f90-acd6-db9b156ee0b5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:17.206172 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1eeb3e0a-05de-4f90-acd6-db9b156ee0b5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:17.206686 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1eeb3e0a-05de-4f90-acd6-db9b156ee0b5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:17.207171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1eeb3e0a-05de-4f90-acd6-db9b156ee0b5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:17.217145 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-aa22cfed-ab6a-4293-bab9-f0a7d2fd45f3 req-b45f232c-1516-4c17-88fe-366a0dbb5adf service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:17.218429 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-aa22cfed-ab6a-4293-bab9-f0a7d2fd45f3 req-b45f232c-1516-4c17-88fe-366a0dbb5adf service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:17.220690 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-aa22cfed-ab6a-4293-bab9-f0a7d2fd45f3 req-b45f232c-1516-4c17-88fe-366a0dbb5adf service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:17.243900 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-aa22cfed-ab6a-4293-bab9-f0a7d2fd45f3 req-b45f232c-1516-4c17-88fe-366a0dbb5adf service nova] Creating event network-changed:7b6fd60a-b00d-41c8-912f-b319241ebfad for instance f1ab2526-7363-4846-86d8-cb2fa6705c76 on hv-cinder-85535 Aug 31 11:08:17.251433 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-aa22cfed-ab6a-4293-bab9-f0a7d2fd45f3 req-b45f232c-1516-4c17-88fe-366a0dbb5adf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076671 Aug 31 11:08:17.252746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 224/405] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:08:17.444733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-1eeb3e0a-05de-4f90-acd6-db9b156ee0b5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:17.454865 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-1eeb3e0a-05de-4f90-acd6-db9b156ee0b5 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1640 microversion: 2.1 time: 0.284565 Aug 31 11:08:17.456509 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 182/406] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:17 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1640 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:17.789255 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-93afd26d-1fca-40b3-ad20-508f40e874a1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:17.789990 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-93afd26d-1fca-40b3-ad20-508f40e874a1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:17.796931 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-93afd26d-1fca-40b3-ad20-508f40e874a1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:17.797374 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-93afd26d-1fca-40b3-ad20-508f40e874a1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:17.797918 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-93afd26d-1fca-40b3-ad20-508f40e874a1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:17.798731 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-93afd26d-1fca-40b3-ad20-508f40e874a1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:17.799232 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-93afd26d-1fca-40b3-ad20-508f40e874a1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:17.799686 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-93afd26d-1fca-40b3-ad20-508f40e874a1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:17.907962 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-da9da51e-8a11-4648-96d5-a68cec44d111 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:17.908642 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-da9da51e-8a11-4648-96d5-a68cec44d111 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:17.916678 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da9da51e-8a11-4648-96d5-a68cec44d111 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:17.917427 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da9da51e-8a11-4648-96d5-a68cec44d111 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:17.918697 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da9da51e-8a11-4648-96d5-a68cec44d111 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:17.919880 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da9da51e-8a11-4648-96d5-a68cec44d111 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:17.920373 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da9da51e-8a11-4648-96d5-a68cec44d111 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:17.920960 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da9da51e-8a11-4648-96d5-a68cec44d111 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:17.971170 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-93afd26d-1fca-40b3-ad20-508f40e874a1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:17.981118 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-93afd26d-1fca-40b3-ad20-508f40e874a1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:17.983004 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-93afd26d-1fca-40b3-ad20-508f40e874a1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:17.984313 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-93afd26d-1fca-40b3-ad20-508f40e874a1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.201179 Aug 31 11:08:17.996281 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 225/407] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:17 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:18.010810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-da9da51e-8a11-4648-96d5-a68cec44d111 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:18.025563 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-da9da51e-8a11-4648-96d5-a68cec44d111 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1204 microversion: 2.1 time: 0.121507 Aug 31 11:08:18.039413 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 183/408] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:17 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1204 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:18.179785 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f9b95a1e-b24d-4a29-a07d-80de158ad9b3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:18.180917 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f9b95a1e-b24d-4a29-a07d-80de158ad9b3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:18.189769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f9b95a1e-b24d-4a29-a07d-80de158ad9b3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:18.190269 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f9b95a1e-b24d-4a29-a07d-80de158ad9b3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:18.190711 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f9b95a1e-b24d-4a29-a07d-80de158ad9b3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:18.191438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f9b95a1e-b24d-4a29-a07d-80de158ad9b3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:18.191894 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f9b95a1e-b24d-4a29-a07d-80de158ad9b3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:18.192347 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f9b95a1e-b24d-4a29-a07d-80de158ad9b3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:18.373864 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f9b95a1e-b24d-4a29-a07d-80de158ad9b3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:18.382721 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f9b95a1e-b24d-4a29-a07d-80de158ad9b3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1370 microversion: 2.1 time: 0.207716 Aug 31 11:08:18.383623 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 226/409] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:18 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:19.008671 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-af8891f7-20d7-4c7e-bd77-c72ea513f161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:19.009309 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-af8891f7-20d7-4c7e-bd77-c72ea513f161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:19.016982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-af8891f7-20d7-4c7e-bd77-c72ea513f161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:19.017617 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-af8891f7-20d7-4c7e-bd77-c72ea513f161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:19.018065 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-af8891f7-20d7-4c7e-bd77-c72ea513f161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:19.018788 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-af8891f7-20d7-4c7e-bd77-c72ea513f161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:19.019240 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-af8891f7-20d7-4c7e-bd77-c72ea513f161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:19.019669 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-af8891f7-20d7-4c7e-bd77-c72ea513f161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:19.047676 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-68518864-da66-468f-bceb-c4fd9da5d7fe tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:19.048494 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-68518864-da66-468f-bceb-c4fd9da5d7fe tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:19.057228 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68518864-da66-468f-bceb-c4fd9da5d7fe tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:19.057978 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68518864-da66-468f-bceb-c4fd9da5d7fe tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:19.058556 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68518864-da66-468f-bceb-c4fd9da5d7fe tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:19.059517 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68518864-da66-468f-bceb-c4fd9da5d7fe tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:19.060270 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68518864-da66-468f-bceb-c4fd9da5d7fe tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:19.060821 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68518864-da66-468f-bceb-c4fd9da5d7fe tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:19.129327 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-68518864-da66-468f-bceb-c4fd9da5d7fe tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:19.139488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-68518864-da66-468f-bceb-c4fd9da5d7fe tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1204 microversion: 2.1 time: 0.095786 Aug 31 11:08:19.140110 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 227/410] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:19 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:08:19.170369 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-af8891f7-20d7-4c7e-bd77-c72ea513f161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:19.180974 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-af8891f7-20d7-4c7e-bd77-c72ea513f161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:19.182667 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-af8891f7-20d7-4c7e-bd77-c72ea513f161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:19.183795 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-af8891f7-20d7-4c7e-bd77-c72ea513f161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1741 microversion: 2.20 time: 0.179572 Aug 31 11:08:19.184769 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 184/411] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:19 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:19.414644 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-79e2e5a4-ca04-4080-b4d5-078a79a4d387 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:19.415588 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-79e2e5a4-ca04-4080-b4d5-078a79a4d387 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:19.421943 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-79e2e5a4-ca04-4080-b4d5-078a79a4d387 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:19.422484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-79e2e5a4-ca04-4080-b4d5-078a79a4d387 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:19.422997 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-79e2e5a4-ca04-4080-b4d5-078a79a4d387 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:19.423739 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-79e2e5a4-ca04-4080-b4d5-078a79a4d387 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:19.424308 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-79e2e5a4-ca04-4080-b4d5-078a79a4d387 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:19.424707 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-79e2e5a4-ca04-4080-b4d5-078a79a4d387 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:19.582120 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-79e2e5a4-ca04-4080-b4d5-078a79a4d387 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:19.595728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-79e2e5a4-ca04-4080-b4d5-078a79a4d387 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1370 microversion: 2.1 time: 0.188900 Aug 31 11:08:19.609412 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 228/412] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:19 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:20.160126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-18b2b5fb-bd8e-41a7-a942-d1ff2be9dff4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:20.160734 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-18b2b5fb-bd8e-41a7-a942-d1ff2be9dff4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:20.167340 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-18b2b5fb-bd8e-41a7-a942-d1ff2be9dff4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:20.167819 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-18b2b5fb-bd8e-41a7-a942-d1ff2be9dff4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:20.168528 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-18b2b5fb-bd8e-41a7-a942-d1ff2be9dff4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:20.169221 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-18b2b5fb-bd8e-41a7-a942-d1ff2be9dff4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:20.169671 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-18b2b5fb-bd8e-41a7-a942-d1ff2be9dff4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:20.170094 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-18b2b5fb-bd8e-41a7-a942-d1ff2be9dff4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:20.215036 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fa6b2b19-09f2-4b31-b793-8578eec06710 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:20.217472 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fa6b2b19-09f2-4b31-b793-8578eec06710 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:20.227017 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa6b2b19-09f2-4b31-b793-8578eec06710 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:20.227515 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa6b2b19-09f2-4b31-b793-8578eec06710 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:20.228385 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa6b2b19-09f2-4b31-b793-8578eec06710 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:20.229876 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa6b2b19-09f2-4b31-b793-8578eec06710 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:20.230526 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa6b2b19-09f2-4b31-b793-8578eec06710 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:20.231141 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa6b2b19-09f2-4b31-b793-8578eec06710 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:20.342038 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-18b2b5fb-bd8e-41a7-a942-d1ff2be9dff4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:20.351253 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-18b2b5fb-bd8e-41a7-a942-d1ff2be9dff4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.194754 Aug 31 11:08:20.352249 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 185/413] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:20 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:20.437438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fa6b2b19-09f2-4b31-b793-8578eec06710 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:20.451587 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fa6b2b19-09f2-4b31-b793-8578eec06710 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:20.454922 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fa6b2b19-09f2-4b31-b793-8578eec06710 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:20.457623 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fa6b2b19-09f2-4b31-b793-8578eec06710 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1723 microversion: 2.20 time: 0.251851 Aug 31 11:08:20.459346 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 229/414] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:20 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:20.617700 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-aadfb1dc-6487-4deb-99a7-0df32e0b4a1e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:20.618759 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-aadfb1dc-6487-4deb-99a7-0df32e0b4a1e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:20.625216 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aadfb1dc-6487-4deb-99a7-0df32e0b4a1e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:20.625817 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aadfb1dc-6487-4deb-99a7-0df32e0b4a1e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:20.626388 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aadfb1dc-6487-4deb-99a7-0df32e0b4a1e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:20.627091 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aadfb1dc-6487-4deb-99a7-0df32e0b4a1e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:20.627536 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aadfb1dc-6487-4deb-99a7-0df32e0b4a1e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:20.627951 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aadfb1dc-6487-4deb-99a7-0df32e0b4a1e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:20.867147 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-aadfb1dc-6487-4deb-99a7-0df32e0b4a1e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:20.875874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-aadfb1dc-6487-4deb-99a7-0df32e0b4a1e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1370 microversion: 2.1 time: 0.262368 Aug 31 11:08:20.876496 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 186/415] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:20 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1370 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:21.270256 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-b76bb066-c42c-450d-9541-bbdaa7d9df55 req-b2728e75-b445-4e3f-8546-2dc737810993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2a8d50-fa16-40f4-9760-25603efd4d6d", "tag": "e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:21.282093 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:21.295864 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b76bb066-c42c-450d-9541-bbdaa7d9df55 req-b2728e75-b445-4e3f-8546-2dc737810993 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:21.297585 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b76bb066-c42c-450d-9541-bbdaa7d9df55 req-b2728e75-b445-4e3f-8546-2dc737810993 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:21.298253 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b76bb066-c42c-450d-9541-bbdaa7d9df55 req-b2728e75-b445-4e3f-8546-2dc737810993 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:21.320100 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-b76bb066-c42c-450d-9541-bbdaa7d9df55 req-b2728e75-b445-4e3f-8546-2dc737810993 service nova] Creating event network-changed:e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13 for instance dd2a8d50-fa16-40f4-9760-25603efd4d6d on hv-cinder-85535 Aug 31 11:08:21.328867 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-b76bb066-c42c-450d-9541-bbdaa7d9df55 req-b2728e75-b445-4e3f-8546-2dc737810993 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061846 Aug 31 11:08:21.330222 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 230/416] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:08:21.383983 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-66565e84-bb0d-40d9-a1df-da4b07951f0a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:21.384653 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-66565e84-bb0d-40d9-a1df-da4b07951f0a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:21.391542 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-66565e84-bb0d-40d9-a1df-da4b07951f0a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:21.392053 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-66565e84-bb0d-40d9-a1df-da4b07951f0a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:21.392498 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-66565e84-bb0d-40d9-a1df-da4b07951f0a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:21.393225 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-66565e84-bb0d-40d9-a1df-da4b07951f0a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:21.393692 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-66565e84-bb0d-40d9-a1df-da4b07951f0a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:21.394118 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-66565e84-bb0d-40d9-a1df-da4b07951f0a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:21.483767 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8a4e4cda-99d8-4396-80d0-dc1461bbcd5c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:21.484589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8a4e4cda-99d8-4396-80d0-dc1461bbcd5c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:21.486652 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=10 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:21.493315 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8a4e4cda-99d8-4396-80d0-dc1461bbcd5c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:21.493810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8a4e4cda-99d8-4396-80d0-dc1461bbcd5c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:21.494243 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8a4e4cda-99d8-4396-80d0-dc1461bbcd5c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:21.494950 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8a4e4cda-99d8-4396-80d0-dc1461bbcd5c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:21.495588 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8a4e4cda-99d8-4396-80d0-dc1461bbcd5c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:21.496029 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8a4e4cda-99d8-4396-80d0-dc1461bbcd5c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:21.726431 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8a4e4cda-99d8-4396-80d0-dc1461bbcd5c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:21.736147 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8a4e4cda-99d8-4396-80d0-dc1461bbcd5c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:21.738522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8a4e4cda-99d8-4396-80d0-dc1461bbcd5c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:21.740039 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8a4e4cda-99d8-4396-80d0-dc1461bbcd5c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1723 microversion: 2.20 time: 0.260759 Aug 31 11:08:21.741294 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 231/417] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:21 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:08:21.779427 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-66565e84-bb0d-40d9-a1df-da4b07951f0a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:21.791382 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-66565e84-bb0d-40d9-a1df-da4b07951f0a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.422271 Aug 31 11:08:21.791976 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 187/418] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:21 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:21.898464 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-103362c3-afe7-4128-bad0-f110d1625a36 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:21.899085 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-103362c3-afe7-4128-bad0-f110d1625a36 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:21.905431 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-103362c3-afe7-4128-bad0-f110d1625a36 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:21.905928 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-103362c3-afe7-4128-bad0-f110d1625a36 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:21.906371 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-103362c3-afe7-4128-bad0-f110d1625a36 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:21.907119 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-103362c3-afe7-4128-bad0-f110d1625a36 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:21.907575 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-103362c3-afe7-4128-bad0-f110d1625a36 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:21.907999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-103362c3-afe7-4128-bad0-f110d1625a36 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:22.255539 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-103362c3-afe7-4128-bad0-f110d1625a36 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:22.266100 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-103362c3-afe7-4128-bad0-f110d1625a36 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1564 microversion: 2.1 time: 0.372454 Aug 31 11:08:22.266688 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 232/419] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:21 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1564 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:22.288500 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a8b66d15-1762-4871-b360-091688549d77 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:22.288777 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a8b66d15-1762-4871-b360-091688549d77 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:22.295271 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a8b66d15-1762-4871-b360-091688549d77 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:22.295765 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a8b66d15-1762-4871-b360-091688549d77 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:22.296307 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a8b66d15-1762-4871-b360-091688549d77 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:22.297023 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a8b66d15-1762-4871-b360-091688549d77 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:22.297543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a8b66d15-1762-4871-b360-091688549d77 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:22.297973 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a8b66d15-1762-4871-b360-091688549d77 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:22.380192 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a8b66d15-1762-4871-b360-091688549d77 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096309 Aug 31 11:08:22.388339 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 188/420] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 11:08:22 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:08:22.763538 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fb716d9d-443f-4bb6-aaed-e169426a3972 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:22.764358 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fb716d9d-443f-4bb6-aaed-e169426a3972 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:22.771237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fb716d9d-443f-4bb6-aaed-e169426a3972 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:22.772233 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fb716d9d-443f-4bb6-aaed-e169426a3972 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:22.772851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fb716d9d-443f-4bb6-aaed-e169426a3972 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:22.773760 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fb716d9d-443f-4bb6-aaed-e169426a3972 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:22.774416 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fb716d9d-443f-4bb6-aaed-e169426a3972 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:22.774988 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fb716d9d-443f-4bb6-aaed-e169426a3972 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:22.813159 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-49de307a-0637-4bbf-ba4c-16e4c0d1666d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:22.814130 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-49de307a-0637-4bbf-ba4c-16e4c0d1666d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:22.821716 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-49de307a-0637-4bbf-ba4c-16e4c0d1666d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:22.822288 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-49de307a-0637-4bbf-ba4c-16e4c0d1666d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:22.822824 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-49de307a-0637-4bbf-ba4c-16e4c0d1666d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:22.823648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-49de307a-0637-4bbf-ba4c-16e4c0d1666d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:22.824130 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-49de307a-0637-4bbf-ba4c-16e4c0d1666d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:22.824586 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-49de307a-0637-4bbf-ba4c-16e4c0d1666d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:23.058578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fb716d9d-443f-4bb6-aaed-e169426a3972 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:23.066048 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-49de307a-0637-4bbf-ba4c-16e4c0d1666d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:23.081751 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fb716d9d-443f-4bb6-aaed-e169426a3972 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:23.085120 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-49de307a-0637-4bbf-ba4c-16e4c0d1666d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.276470 Aug 31 11:08:23.086526 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 189/421] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:22 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:08:23.089461 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fb716d9d-443f-4bb6-aaed-e169426a3972 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:23.092126 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fb716d9d-443f-4bb6-aaed-e169426a3972 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1723 microversion: 2.20 time: 0.332466 Aug 31 11:08:23.095554 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 233/422] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:22 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:23.097329 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-da196a78-23e4-47c3-a0f2-5c66884db687 req-2114c24d-298f-4cc6-8017-0c8b99bc37e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e", "name": "network-vif-unplugged", "status": "completed", "tag": "a2414d6d-8b79-405f-a378-ffbb986542cb"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:23.118822 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-da196a78-23e4-47c3-a0f2-5c66884db687 req-2114c24d-298f-4cc6-8017-0c8b99bc37e2 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:23.119431 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-da196a78-23e4-47c3-a0f2-5c66884db687 req-2114c24d-298f-4cc6-8017-0c8b99bc37e2 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:23.120134 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-da196a78-23e4-47c3-a0f2-5c66884db687 req-2114c24d-298f-4cc6-8017-0c8b99bc37e2 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:23.135575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-da196a78-23e4-47c3-a0f2-5c66884db687 req-2114c24d-298f-4cc6-8017-0c8b99bc37e2 service nova] Creating event network-vif-unplugged:a2414d6d-8b79-405f-a378-ffbb986542cb for instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e on hv-cinder-85535 Aug 31 11:08:23.141335 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-da196a78-23e4-47c3-a0f2-5c66884db687 req-2114c24d-298f-4cc6-8017-0c8b99bc37e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052043 Aug 31 11:08:23.141942 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 190/423] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:08:23.684937 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-777bdf63-90a9-4262-82f2-336bf4d34dd6 req-c113685d-886c-429b-9736-f35b7cf1ed9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01be6c4-bf01-4970-87ca-7c8e3cf14524", "tag": "a567e33c-5895-4192-99c1-30a51a815ee5"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:23.694472 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-777bdf63-90a9-4262-82f2-336bf4d34dd6 req-c113685d-886c-429b-9736-f35b7cf1ed9b service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:23.694951 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-777bdf63-90a9-4262-82f2-336bf4d34dd6 req-c113685d-886c-429b-9736-f35b7cf1ed9b service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:23.695388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-777bdf63-90a9-4262-82f2-336bf4d34dd6 req-c113685d-886c-429b-9736-f35b7cf1ed9b service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:23.707161 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-777bdf63-90a9-4262-82f2-336bf4d34dd6 req-c113685d-886c-429b-9736-f35b7cf1ed9b service nova] Creating event network-changed:a567e33c-5895-4192-99c1-30a51a815ee5 for instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 on hv-cinder-85535 Aug 31 11:08:23.712956 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-777bdf63-90a9-4262-82f2-336bf4d34dd6 req-c113685d-886c-429b-9736-f35b7cf1ed9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031563 Aug 31 11:08:23.713574 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 234/424] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:08:24.110364 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d5551122-dc76-402a-bf93-0414612d941d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:24.111906 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d5551122-dc76-402a-bf93-0414612d941d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:24.124203 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-359560f1-ffa6-4b58-8d5b-ce5c5a0fad86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:24.125582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-359560f1-ffa6-4b58-8d5b-ce5c5a0fad86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:24.135575 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-359560f1-ffa6-4b58-8d5b-ce5c5a0fad86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:24.136765 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5551122-dc76-402a-bf93-0414612d941d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:24.137410 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5551122-dc76-402a-bf93-0414612d941d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:24.138053 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5551122-dc76-402a-bf93-0414612d941d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:24.138728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-359560f1-ffa6-4b58-8d5b-ce5c5a0fad86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:24.139613 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5551122-dc76-402a-bf93-0414612d941d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:24.140248 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-359560f1-ffa6-4b58-8d5b-ce5c5a0fad86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:24.140872 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5551122-dc76-402a-bf93-0414612d941d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:24.142868 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-359560f1-ffa6-4b58-8d5b-ce5c5a0fad86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:24.143535 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5551122-dc76-402a-bf93-0414612d941d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:24.147190 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-359560f1-ffa6-4b58-8d5b-ce5c5a0fad86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:24.147902 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-359560f1-ffa6-4b58-8d5b-ce5c5a0fad86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:24.380244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-359560f1-ffa6-4b58-8d5b-ce5c5a0fad86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:24.399723 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-359560f1-ffa6-4b58-8d5b-ce5c5a0fad86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:24.405248 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-359560f1-ffa6-4b58-8d5b-ce5c5a0fad86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:24.409975 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-359560f1-ffa6-4b58-8d5b-ce5c5a0fad86 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1723 microversion: 2.20 time: 0.290556 Aug 31 11:08:24.410551 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 235/425] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:24 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:24.430094 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d5551122-dc76-402a-bf93-0414612d941d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:24.438176 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d5551122-dc76-402a-bf93-0414612d941d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.332221 Aug 31 11:08:24.438749 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 191/426] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:24 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:25.434867 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8b17e609-985d-47c1-a889-5c29352e6cef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:25.435492 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8b17e609-985d-47c1-a889-5c29352e6cef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:25.442218 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8b17e609-985d-47c1-a889-5c29352e6cef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:25.442695 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8b17e609-985d-47c1-a889-5c29352e6cef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:25.443129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8b17e609-985d-47c1-a889-5c29352e6cef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:25.443971 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8b17e609-985d-47c1-a889-5c29352e6cef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:25.444452 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8b17e609-985d-47c1-a889-5c29352e6cef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:25.444869 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8b17e609-985d-47c1-a889-5c29352e6cef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:25.459251 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-dbd28089-f54e-4808-907b-94c9d37eff08 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:25.460372 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-dbd28089-f54e-4808-907b-94c9d37eff08 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:25.466313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dbd28089-f54e-4808-907b-94c9d37eff08 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:25.466791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dbd28089-f54e-4808-907b-94c9d37eff08 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:25.467218 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dbd28089-f54e-4808-907b-94c9d37eff08 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:25.467907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dbd28089-f54e-4808-907b-94c9d37eff08 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:25.468380 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dbd28089-f54e-4808-907b-94c9d37eff08 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:25.468797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dbd28089-f54e-4808-907b-94c9d37eff08 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:25.588696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8b17e609-985d-47c1-a889-5c29352e6cef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:25.597367 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8b17e609-985d-47c1-a889-5c29352e6cef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:25.614442 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8b17e609-985d-47c1-a889-5c29352e6cef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:25.616503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8b17e609-985d-47c1-a889-5c29352e6cef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1726 microversion: 2.20 time: 0.185104 Aug 31 11:08:25.617108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 236/427] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:25 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:08:25.640670 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3035a265-1daa-44c6-bb64-e75469d4e6ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40eff4d2-944b-4d7b-ba1e-a3a2688992cc"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:25.643403 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3035a265-1daa-44c6-bb64-e75469d4e6ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:25.650404 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3035a265-1daa-44c6-bb64-e75469d4e6ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:25.650891 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3035a265-1daa-44c6-bb64-e75469d4e6ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:25.651341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3035a265-1daa-44c6-bb64-e75469d4e6ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:25.652059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3035a265-1daa-44c6-bb64-e75469d4e6ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:25.652513 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3035a265-1daa-44c6-bb64-e75469d4e6ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:25.652934 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3035a265-1daa-44c6-bb64-e75469d4e6ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:25.691372 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-dbd28089-f54e-4808-907b-94c9d37eff08 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:25.702399 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-dbd28089-f54e-4808-907b-94c9d37eff08 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.247053 Aug 31 11:08:25.703807 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 192/428] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:25 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:08:26.034756 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3035a265-1daa-44c6-bb64-e75469d4e6ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "POST /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.397987 Aug 31 11:08:26.035592 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 237/429] 10.222.0.20 () {62 vars in 1364 bytes} [Wed Aug 31 11:08:25 2022] POST /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-volume_attachments => generated 188 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 11:08:26.199282 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cadff6cf-f5a8-44cc-b418-14a06f718d6d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:26.201188 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-cadff6cf-f5a8-44cc-b418-14a06f718d6d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:26.207592 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cadff6cf-f5a8-44cc-b418-14a06f718d6d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:26.208220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cadff6cf-f5a8-44cc-b418-14a06f718d6d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:26.208542 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cadff6cf-f5a8-44cc-b418-14a06f718d6d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:26.209379 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cadff6cf-f5a8-44cc-b418-14a06f718d6d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:26.210128 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cadff6cf-f5a8-44cc-b418-14a06f718d6d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:26.210723 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cadff6cf-f5a8-44cc-b418-14a06f718d6d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:26.281335 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-cadff6cf-f5a8-44cc-b418-14a06f718d6d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120655) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 11:08:26.371170 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-cadff6cf-f5a8-44cc-b418-14a06f718d6d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "POST /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/action" status: 202 len: 0 microversion: 2.20 time: 0.185086 Aug 31 11:08:26.380231 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7115b55d-256d-494a-897c-9c25199e5b0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:26.381378 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 193/430] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 31 11:08:26 2022] POST /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:08:26.382259 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7115b55d-256d-494a-897c-9c25199e5b0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:26.389786 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:26.391493 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7115b55d-256d-494a-897c-9c25199e5b0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:26.392109 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7115b55d-256d-494a-897c-9c25199e5b0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:26.392821 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7115b55d-256d-494a-897c-9c25199e5b0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:26.393438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7115b55d-256d-494a-897c-9c25199e5b0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:26.393877 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7115b55d-256d-494a-897c-9c25199e5b0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:26.394475 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7115b55d-256d-494a-897c-9c25199e5b0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:26.411405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:26.562859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7115b55d-256d-494a-897c-9c25199e5b0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:26.572423 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7115b55d-256d-494a-897c-9c25199e5b0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:26.574283 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7115b55d-256d-494a-897c-9c25199e5b0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:26.575467 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7115b55d-256d-494a-897c-9c25199e5b0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1752 microversion: 2.20 time: 0.199296 Aug 31 11:08:26.576843 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 238/431] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:26 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:26.733600 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-2c7412b7-6204-4b2f-b482-b9d593c105c6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:26.734757 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-2c7412b7-6204-4b2f-b482-b9d593c105c6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:26.743055 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2c7412b7-6204-4b2f-b482-b9d593c105c6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:26.743550 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2c7412b7-6204-4b2f-b482-b9d593c105c6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:26.744133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2c7412b7-6204-4b2f-b482-b9d593c105c6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:26.745085 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2c7412b7-6204-4b2f-b482-b9d593c105c6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:26.745545 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2c7412b7-6204-4b2f-b482-b9d593c105c6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:26.745977 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2c7412b7-6204-4b2f-b482-b9d593c105c6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:26.894029 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-2c7412b7-6204-4b2f-b482-b9d593c105c6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:26.902688 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-2c7412b7-6204-4b2f-b482-b9d593c105c6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.175992 Aug 31 11:08:26.903308 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 194/432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:26 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:27.600617 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-cf9d4fe0-56ee-4be2-b31e-7cf6779ea193 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:27.601347 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-cf9d4fe0-56ee-4be2-b31e-7cf6779ea193 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:27.608430 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cf9d4fe0-56ee-4be2-b31e-7cf6779ea193 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:27.608927 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cf9d4fe0-56ee-4be2-b31e-7cf6779ea193 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:27.609367 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cf9d4fe0-56ee-4be2-b31e-7cf6779ea193 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:27.610086 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cf9d4fe0-56ee-4be2-b31e-7cf6779ea193 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:27.610545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cf9d4fe0-56ee-4be2-b31e-7cf6779ea193 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:27.610973 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cf9d4fe0-56ee-4be2-b31e-7cf6779ea193 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:27.751868 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-cf9d4fe0-56ee-4be2-b31e-7cf6779ea193 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:27.762145 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-cf9d4fe0-56ee-4be2-b31e-7cf6779ea193 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:27.763814 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-cf9d4fe0-56ee-4be2-b31e-7cf6779ea193 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:27.764989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-cf9d4fe0-56ee-4be2-b31e-7cf6779ea193 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1752 microversion: 2.20 time: 0.168594 Aug 31 11:08:27.765609 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 239/433] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:27 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:08:27.922848 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a11607f3-a20d-40ff-b2f8-9139307f3545 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:27.923448 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a11607f3-a20d-40ff-b2f8-9139307f3545 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:27.930269 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a11607f3-a20d-40ff-b2f8-9139307f3545 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:27.930761 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a11607f3-a20d-40ff-b2f8-9139307f3545 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:27.931202 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a11607f3-a20d-40ff-b2f8-9139307f3545 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:27.931908 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a11607f3-a20d-40ff-b2f8-9139307f3545 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:27.932386 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a11607f3-a20d-40ff-b2f8-9139307f3545 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:27.932810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a11607f3-a20d-40ff-b2f8-9139307f3545 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:28.067369 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a11607f3-a20d-40ff-b2f8-9139307f3545 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:28.075211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a11607f3-a20d-40ff-b2f8-9139307f3545 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.156172 Aug 31 11:08:28.075770 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 195/434] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:27 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:28.788481 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c814f064-e6bd-4e69-94da-863d05b37fd4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:28.789082 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c814f064-e6bd-4e69-94da-863d05b37fd4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:28.795646 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c814f064-e6bd-4e69-94da-863d05b37fd4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:28.796155 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c814f064-e6bd-4e69-94da-863d05b37fd4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:28.796583 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c814f064-e6bd-4e69-94da-863d05b37fd4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:28.797273 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c814f064-e6bd-4e69-94da-863d05b37fd4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:28.797712 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c814f064-e6bd-4e69-94da-863d05b37fd4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:28.798126 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c814f064-e6bd-4e69-94da-863d05b37fd4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:28.939472 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c814f064-e6bd-4e69-94da-863d05b37fd4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:28.949131 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c814f064-e6bd-4e69-94da-863d05b37fd4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:28.950513 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c814f064-e6bd-4e69-94da-863d05b37fd4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:28.951686 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c814f064-e6bd-4e69-94da-863d05b37fd4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.167069 Aug 31 11:08:28.952307 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 240/435] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:28 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:29.096695 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6aef63f5-b369-4d0e-81e3-e51a534167b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:29.097303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6aef63f5-b369-4d0e-81e3-e51a534167b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:29.104223 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6aef63f5-b369-4d0e-81e3-e51a534167b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:29.104706 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6aef63f5-b369-4d0e-81e3-e51a534167b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:29.105140 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6aef63f5-b369-4d0e-81e3-e51a534167b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:29.105837 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6aef63f5-b369-4d0e-81e3-e51a534167b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:29.106289 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6aef63f5-b369-4d0e-81e3-e51a534167b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:29.106715 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6aef63f5-b369-4d0e-81e3-e51a534167b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:29.247141 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6aef63f5-b369-4d0e-81e3-e51a534167b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:29.255044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6aef63f5-b369-4d0e-81e3-e51a534167b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.162208 Aug 31 11:08:29.256286 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 196/436] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:29 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:29.976911 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-abde0ca3-8a21-4f13-bca3-bbbba3260de1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:29.977515 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-abde0ca3-8a21-4f13-bca3-bbbba3260de1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:29.983964 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-abde0ca3-8a21-4f13-bca3-bbbba3260de1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:29.984471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-abde0ca3-8a21-4f13-bca3-bbbba3260de1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:29.984992 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-abde0ca3-8a21-4f13-bca3-bbbba3260de1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:29.985680 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-abde0ca3-8a21-4f13-bca3-bbbba3260de1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:29.986121 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-abde0ca3-8a21-4f13-bca3-bbbba3260de1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:29.986536 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-abde0ca3-8a21-4f13-bca3-bbbba3260de1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:30.118894 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-abde0ca3-8a21-4f13-bca3-bbbba3260de1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:30.127736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-abde0ca3-8a21-4f13-bca3-bbbba3260de1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:30.129217 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-abde0ca3-8a21-4f13-bca3-bbbba3260de1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:30.130978 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-abde0ca3-8a21-4f13-bca3-bbbba3260de1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.158169 Aug 31 11:08:30.131548 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 241/437] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:29 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:30.276246 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-46660a70-d796-45b2-bdf3-1581fa241f55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:30.276846 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-46660a70-d796-45b2-bdf3-1581fa241f55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:30.282834 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-46660a70-d796-45b2-bdf3-1581fa241f55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:30.283308 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-46660a70-d796-45b2-bdf3-1581fa241f55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:30.283739 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-46660a70-d796-45b2-bdf3-1581fa241f55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:30.284469 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-46660a70-d796-45b2-bdf3-1581fa241f55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:30.284909 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-46660a70-d796-45b2-bdf3-1581fa241f55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:30.285356 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-46660a70-d796-45b2-bdf3-1581fa241f55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:30.438661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-46660a70-d796-45b2-bdf3-1581fa241f55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:30.449069 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-46660a70-d796-45b2-bdf3-1581fa241f55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.176560 Aug 31 11:08:30.449793 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 197/438] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:30 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:31.153910 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-85501fdf-090b-4d0f-bae6-227111326ac4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:31.154519 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-85501fdf-090b-4d0f-bae6-227111326ac4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:31.161042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-85501fdf-090b-4d0f-bae6-227111326ac4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:31.161510 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-85501fdf-090b-4d0f-bae6-227111326ac4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:31.162625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-85501fdf-090b-4d0f-bae6-227111326ac4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:31.163464 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-85501fdf-090b-4d0f-bae6-227111326ac4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:31.163922 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-85501fdf-090b-4d0f-bae6-227111326ac4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:31.164377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-85501fdf-090b-4d0f-bae6-227111326ac4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:31.304454 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-85501fdf-090b-4d0f-bae6-227111326ac4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:31.314062 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-85501fdf-090b-4d0f-bae6-227111326ac4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:31.315506 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-85501fdf-090b-4d0f-bae6-227111326ac4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:31.316698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-85501fdf-090b-4d0f-bae6-227111326ac4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.166689 Aug 31 11:08:31.317247 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 242/439] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:31 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:31.475917 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-682e6154-db1e-42be-823f-89906ecdc1b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:31.477852 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-682e6154-db1e-42be-823f-89906ecdc1b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:31.487727 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-682e6154-db1e-42be-823f-89906ecdc1b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:31.488829 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-682e6154-db1e-42be-823f-89906ecdc1b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:31.489630 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-682e6154-db1e-42be-823f-89906ecdc1b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:31.490898 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-682e6154-db1e-42be-823f-89906ecdc1b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:31.491605 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-682e6154-db1e-42be-823f-89906ecdc1b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:31.492472 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-682e6154-db1e-42be-823f-89906ecdc1b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:31.516802 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:31.661277 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-682e6154-db1e-42be-823f-89906ecdc1b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:31.683000 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-682e6154-db1e-42be-823f-89906ecdc1b5 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.213352 Aug 31 11:08:31.683791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 198/440] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:31 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:32.340886 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c944180c-c44d-4028-9f54-f6528507677e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:32.342432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c944180c-c44d-4028-9f54-f6528507677e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:32.352527 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c944180c-c44d-4028-9f54-f6528507677e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:32.354373 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c944180c-c44d-4028-9f54-f6528507677e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:32.355629 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c944180c-c44d-4028-9f54-f6528507677e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:32.356847 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c944180c-c44d-4028-9f54-f6528507677e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:32.357294 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c944180c-c44d-4028-9f54-f6528507677e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:32.357720 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c944180c-c44d-4028-9f54-f6528507677e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:32.505841 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c944180c-c44d-4028-9f54-f6528507677e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:32.515908 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c944180c-c44d-4028-9f54-f6528507677e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:32.517503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c944180c-c44d-4028-9f54-f6528507677e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:32.518706 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c944180c-c44d-4028-9f54-f6528507677e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.182738 Aug 31 11:08:32.519605 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 243/441] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:32 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:32.706301 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-08880015-e5ac-4b89-a3eb-69261f1649c3 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:32.706911 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-08880015-e5ac-4b89-a3eb-69261f1649c3 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:32.708947 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:32.714275 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-08880015-e5ac-4b89-a3eb-69261f1649c3 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:32.714763 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-08880015-e5ac-4b89-a3eb-69261f1649c3 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:32.715198 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-08880015-e5ac-4b89-a3eb-69261f1649c3 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:32.715907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-08880015-e5ac-4b89-a3eb-69261f1649c3 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:32.716427 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-08880015-e5ac-4b89-a3eb-69261f1649c3 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:32.716849 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-08880015-e5ac-4b89-a3eb-69261f1649c3 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:32.902972 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-08880015-e5ac-4b89-a3eb-69261f1649c3 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:32.914193 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-08880015-e5ac-4b89-a3eb-69261f1649c3 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.211755 Aug 31 11:08:32.914780 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 199/442] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:32 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:33.543954 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8ad9ab93-8be6-4dff-b50d-c41047f2d497 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:33.545429 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8ad9ab93-8be6-4dff-b50d-c41047f2d497 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:33.555930 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ad9ab93-8be6-4dff-b50d-c41047f2d497 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:33.556928 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ad9ab93-8be6-4dff-b50d-c41047f2d497 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:33.558143 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ad9ab93-8be6-4dff-b50d-c41047f2d497 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:33.559136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ad9ab93-8be6-4dff-b50d-c41047f2d497 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:33.559879 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ad9ab93-8be6-4dff-b50d-c41047f2d497 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:33.560784 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ad9ab93-8be6-4dff-b50d-c41047f2d497 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:33.767631 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8ad9ab93-8be6-4dff-b50d-c41047f2d497 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:33.790202 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8ad9ab93-8be6-4dff-b50d-c41047f2d497 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:33.791980 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8ad9ab93-8be6-4dff-b50d-c41047f2d497 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:33.793842 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8ad9ab93-8be6-4dff-b50d-c41047f2d497 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.254852 Aug 31 11:08:33.794504 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 244/443] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:33 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:33.936064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4aa63659-cda8-49f7-9d4a-3a1ddfed55e7 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:33.938135 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-4aa63659-cda8-49f7-9d4a-3a1ddfed55e7 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:33.945195 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4aa63659-cda8-49f7-9d4a-3a1ddfed55e7 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:33.946112 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4aa63659-cda8-49f7-9d4a-3a1ddfed55e7 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:33.946785 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4aa63659-cda8-49f7-9d4a-3a1ddfed55e7 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:33.948652 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4aa63659-cda8-49f7-9d4a-3a1ddfed55e7 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:33.949412 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4aa63659-cda8-49f7-9d4a-3a1ddfed55e7 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:33.950180 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4aa63659-cda8-49f7-9d4a-3a1ddfed55e7 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:34.113057 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4aa63659-cda8-49f7-9d4a-3a1ddfed55e7 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:34.126563 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4aa63659-cda8-49f7-9d4a-3a1ddfed55e7 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.194214 Aug 31 11:08:34.127306 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 200/444] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:33 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:34.822676 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7dc98115-d960-44d3-8b65-015cba28f5a4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:34.823307 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7dc98115-d960-44d3-8b65-015cba28f5a4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:34.829955 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7dc98115-d960-44d3-8b65-015cba28f5a4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:34.830446 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7dc98115-d960-44d3-8b65-015cba28f5a4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:34.830881 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7dc98115-d960-44d3-8b65-015cba28f5a4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:34.831583 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7dc98115-d960-44d3-8b65-015cba28f5a4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:34.832149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7dc98115-d960-44d3-8b65-015cba28f5a4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:34.832581 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7dc98115-d960-44d3-8b65-015cba28f5a4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:35.013441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7dc98115-d960-44d3-8b65-015cba28f5a4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:35.024418 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7dc98115-d960-44d3-8b65-015cba28f5a4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:35.026082 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7dc98115-d960-44d3-8b65-015cba28f5a4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:35.027448 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7dc98115-d960-44d3-8b65-015cba28f5a4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.208837 Aug 31 11:08:35.028618 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 245/445] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:34 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:35.149702 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d3bbc981-06ad-4809-a163-e35661959f6d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:35.151007 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d3bbc981-06ad-4809-a163-e35661959f6d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:35.158321 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3bbc981-06ad-4809-a163-e35661959f6d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:35.159105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3bbc981-06ad-4809-a163-e35661959f6d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:35.159719 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3bbc981-06ad-4809-a163-e35661959f6d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:35.160643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3bbc981-06ad-4809-a163-e35661959f6d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:35.161264 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3bbc981-06ad-4809-a163-e35661959f6d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:35.162436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3bbc981-06ad-4809-a163-e35661959f6d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:35.327626 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d3bbc981-06ad-4809-a163-e35661959f6d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:35.336134 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d3bbc981-06ad-4809-a163-e35661959f6d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.191361 Aug 31 11:08:35.336803 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 201/446] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:35 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:36.051552 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4004f22b-c4af-4c4b-8306-913a2a0cb9ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:36.052245 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4004f22b-c4af-4c4b-8306-913a2a0cb9ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:36.059844 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4004f22b-c4af-4c4b-8306-913a2a0cb9ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:36.060538 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4004f22b-c4af-4c4b-8306-913a2a0cb9ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:36.060812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4004f22b-c4af-4c4b-8306-913a2a0cb9ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:36.061525 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4004f22b-c4af-4c4b-8306-913a2a0cb9ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:36.061981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4004f22b-c4af-4c4b-8306-913a2a0cb9ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:36.062408 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4004f22b-c4af-4c4b-8306-913a2a0cb9ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:36.243584 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4004f22b-c4af-4c4b-8306-913a2a0cb9ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:36.254344 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4004f22b-c4af-4c4b-8306-913a2a0cb9ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:36.256511 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4004f22b-c4af-4c4b-8306-913a2a0cb9ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:36.257738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4004f22b-c4af-4c4b-8306-913a2a0cb9ef tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.210201 Aug 31 11:08:36.258478 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 246/447] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:36 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:36.358226 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1ba76846-c353-483e-93da-01f62eb02509 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:36.358825 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-1ba76846-c353-483e-93da-01f62eb02509 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:36.366262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1ba76846-c353-483e-93da-01f62eb02509 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:36.366840 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1ba76846-c353-483e-93da-01f62eb02509 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:36.367345 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1ba76846-c353-483e-93da-01f62eb02509 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:36.368095 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1ba76846-c353-483e-93da-01f62eb02509 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:36.368546 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1ba76846-c353-483e-93da-01f62eb02509 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:36.368964 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1ba76846-c353-483e-93da-01f62eb02509 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:36.541496 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-1ba76846-c353-483e-93da-01f62eb02509 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:36.549796 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-1ba76846-c353-483e-93da-01f62eb02509 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.195570 Aug 31 11:08:36.550378 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 202/448] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:36 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:08:37.296649 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-53d8f562-07dd-4e9d-8a7c-00ee4232cd9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:37.297888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-53d8f562-07dd-4e9d-8a7c-00ee4232cd9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:37.305919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53d8f562-07dd-4e9d-8a7c-00ee4232cd9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:37.306409 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53d8f562-07dd-4e9d-8a7c-00ee4232cd9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:37.306846 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53d8f562-07dd-4e9d-8a7c-00ee4232cd9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:37.307555 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53d8f562-07dd-4e9d-8a7c-00ee4232cd9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:37.308015 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53d8f562-07dd-4e9d-8a7c-00ee4232cd9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:37.308538 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53d8f562-07dd-4e9d-8a7c-00ee4232cd9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:37.490788 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-53d8f562-07dd-4e9d-8a7c-00ee4232cd9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:37.500233 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-53d8f562-07dd-4e9d-8a7c-00ee4232cd9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:37.501976 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-53d8f562-07dd-4e9d-8a7c-00ee4232cd9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:37.503354 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-53d8f562-07dd-4e9d-8a7c-00ee4232cd9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.212367 Aug 31 11:08:37.503897 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 247/449] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:37 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:37.571304 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-eaef2d57-5462-44aa-87bc-0161bfbe4b03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:37.571966 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-eaef2d57-5462-44aa-87bc-0161bfbe4b03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:37.578709 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eaef2d57-5462-44aa-87bc-0161bfbe4b03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:37.579203 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eaef2d57-5462-44aa-87bc-0161bfbe4b03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:37.579643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eaef2d57-5462-44aa-87bc-0161bfbe4b03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:37.580387 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eaef2d57-5462-44aa-87bc-0161bfbe4b03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:37.580841 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eaef2d57-5462-44aa-87bc-0161bfbe4b03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:37.581266 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eaef2d57-5462-44aa-87bc-0161bfbe4b03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:37.738020 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-eaef2d57-5462-44aa-87bc-0161bfbe4b03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:37.746680 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-eaef2d57-5462-44aa-87bc-0161bfbe4b03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.179738 Aug 31 11:08:37.747266 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 203/450] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:37 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:38.193698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-d29668c2-3f90-41f1-82e8-eef8f36aeb7e req-e5751d78-ee1e-40b4-9f60-30ca2d177ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2a8d50-fa16-40f4-9760-25603efd4d6d", "name": "network-vif-plugged", "status": "completed", "tag": "e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:38.219429 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-d29668c2-3f90-41f1-82e8-eef8f36aeb7e req-e5751d78-ee1e-40b4-9f60-30ca2d177ab1 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:38.220912 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-d29668c2-3f90-41f1-82e8-eef8f36aeb7e req-e5751d78-ee1e-40b4-9f60-30ca2d177ab1 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:38.221930 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-d29668c2-3f90-41f1-82e8-eef8f36aeb7e req-e5751d78-ee1e-40b4-9f60-30ca2d177ab1 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:38.251075 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-d29668c2-3f90-41f1-82e8-eef8f36aeb7e req-e5751d78-ee1e-40b4-9f60-30ca2d177ab1 service nova] Creating event network-vif-plugged:e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13 for instance dd2a8d50-fa16-40f4-9760-25603efd4d6d on hv-cinder-85535 Aug 31 11:08:38.266823 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-d29668c2-3f90-41f1-82e8-eef8f36aeb7e req-e5751d78-ee1e-40b4-9f60-30ca2d177ab1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080713 Aug 31 11:08:38.267760 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 248/451] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:08:38.528062 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6cbc859c-35c0-439f-8b61-2a303bc2d2d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:38.528694 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6cbc859c-35c0-439f-8b61-2a303bc2d2d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:38.534731 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6cbc859c-35c0-439f-8b61-2a303bc2d2d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:38.535206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6cbc859c-35c0-439f-8b61-2a303bc2d2d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:38.535639 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6cbc859c-35c0-439f-8b61-2a303bc2d2d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:38.536513 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6cbc859c-35c0-439f-8b61-2a303bc2d2d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:38.536967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6cbc859c-35c0-439f-8b61-2a303bc2d2d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:38.537389 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6cbc859c-35c0-439f-8b61-2a303bc2d2d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:38.721430 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6cbc859c-35c0-439f-8b61-2a303bc2d2d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:38.730449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6cbc859c-35c0-439f-8b61-2a303bc2d2d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:38.731915 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6cbc859c-35c0-439f-8b61-2a303bc2d2d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:38.733130 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6cbc859c-35c0-439f-8b61-2a303bc2d2d5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.209143 Aug 31 11:08:38.733684 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 204/452] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:38 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:38.769521 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5b764942-06cb-4e2a-8f2d-76237c173623 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:38.770214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5b764942-06cb-4e2a-8f2d-76237c173623 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:38.777331 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b764942-06cb-4e2a-8f2d-76237c173623 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:38.777838 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b764942-06cb-4e2a-8f2d-76237c173623 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:38.778320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b764942-06cb-4e2a-8f2d-76237c173623 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:38.778959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b764942-06cb-4e2a-8f2d-76237c173623 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:38.779416 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b764942-06cb-4e2a-8f2d-76237c173623 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:38.779840 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5b764942-06cb-4e2a-8f2d-76237c173623 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:38.933244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-5b764942-06cb-4e2a-8f2d-76237c173623 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:38.942323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-5b764942-06cb-4e2a-8f2d-76237c173623 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.177283 Aug 31 11:08:38.946463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 249/453] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:38 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:39.756474 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1030e249-ac34-4fd8-abdf-6996c88cb88b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:39.757771 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-1030e249-ac34-4fd8-abdf-6996c88cb88b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:39.764379 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1030e249-ac34-4fd8-abdf-6996c88cb88b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:39.765127 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1030e249-ac34-4fd8-abdf-6996c88cb88b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:39.765719 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1030e249-ac34-4fd8-abdf-6996c88cb88b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:39.766655 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1030e249-ac34-4fd8-abdf-6996c88cb88b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:39.767912 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1030e249-ac34-4fd8-abdf-6996c88cb88b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:39.768547 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1030e249-ac34-4fd8-abdf-6996c88cb88b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:39.958555 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-1030e249-ac34-4fd8-abdf-6996c88cb88b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:39.970754 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-1030e249-ac34-4fd8-abdf-6996c88cb88b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:39.972552 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-1030e249-ac34-4fd8-abdf-6996c88cb88b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:39.974019 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-1030e249-ac34-4fd8-abdf-6996c88cb88b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.221264 Aug 31 11:08:39.975079 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 205/454] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:39 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:39.977286 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-10131376-29ea-4fc9-9e8e-d5e45d0d06ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:39.979183 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-10131376-29ea-4fc9-9e8e-d5e45d0d06ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:39.990937 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-10131376-29ea-4fc9-9e8e-d5e45d0d06ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:39.991667 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-10131376-29ea-4fc9-9e8e-d5e45d0d06ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:39.992304 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-10131376-29ea-4fc9-9e8e-d5e45d0d06ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:39.993729 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-10131376-29ea-4fc9-9e8e-d5e45d0d06ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:39.993729 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-10131376-29ea-4fc9-9e8e-d5e45d0d06ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:39.994216 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-10131376-29ea-4fc9-9e8e-d5e45d0d06ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:40.148367 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-10131376-29ea-4fc9-9e8e-d5e45d0d06ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:40.157043 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-10131376-29ea-4fc9-9e8e-d5e45d0d06ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.186130 Aug 31 11:08:40.157677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 250/455] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:39 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:40.998577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3f06d0b5-ff07-4453-a99e-529b9831c392 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:40.999182 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3f06d0b5-ff07-4453-a99e-529b9831c392 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:41.006363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f06d0b5-ff07-4453-a99e-529b9831c392 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:41.007094 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f06d0b5-ff07-4453-a99e-529b9831c392 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:41.007533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f06d0b5-ff07-4453-a99e-529b9831c392 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:41.008291 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f06d0b5-ff07-4453-a99e-529b9831c392 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:41.008753 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f06d0b5-ff07-4453-a99e-529b9831c392 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:41.009149 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f06d0b5-ff07-4453-a99e-529b9831c392 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:41.142586 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3f06d0b5-ff07-4453-a99e-529b9831c392 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:41.151680 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3f06d0b5-ff07-4453-a99e-529b9831c392 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:41.153142 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3f06d0b5-ff07-4453-a99e-529b9831c392 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:41.154290 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3f06d0b5-ff07-4453-a99e-529b9831c392 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.159599 Aug 31 11:08:41.154845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 206/456] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:40 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:41.179815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2855831e-53c6-45fb-ad11-de9ca618f67d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:41.180456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2855831e-53c6-45fb-ad11-de9ca618f67d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:41.187133 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2855831e-53c6-45fb-ad11-de9ca618f67d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:41.187615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2855831e-53c6-45fb-ad11-de9ca618f67d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:41.188096 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2855831e-53c6-45fb-ad11-de9ca618f67d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:41.188791 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2855831e-53c6-45fb-ad11-de9ca618f67d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:41.189235 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2855831e-53c6-45fb-ad11-de9ca618f67d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:41.189652 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2855831e-53c6-45fb-ad11-de9ca618f67d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:41.328531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2855831e-53c6-45fb-ad11-de9ca618f67d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:41.336303 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2855831e-53c6-45fb-ad11-de9ca618f67d tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.161265 Aug 31 11:08:41.336878 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 251/457] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:41 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:08:42.177459 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cc02723d-175c-46da-b9e7-fad76b0b6d56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:42.178053 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-cc02723d-175c-46da-b9e7-fad76b0b6d56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:42.184098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc02723d-175c-46da-b9e7-fad76b0b6d56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:42.184583 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc02723d-175c-46da-b9e7-fad76b0b6d56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:42.185018 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc02723d-175c-46da-b9e7-fad76b0b6d56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:42.185735 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc02723d-175c-46da-b9e7-fad76b0b6d56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:42.186189 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc02723d-175c-46da-b9e7-fad76b0b6d56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:42.186619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cc02723d-175c-46da-b9e7-fad76b0b6d56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:42.320850 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-cc02723d-175c-46da-b9e7-fad76b0b6d56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:42.329392 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-cc02723d-175c-46da-b9e7-fad76b0b6d56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:42.330841 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-cc02723d-175c-46da-b9e7-fad76b0b6d56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:42.332054 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-cc02723d-175c-46da-b9e7-fad76b0b6d56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.158727 Aug 31 11:08:42.332595 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 207/458] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:42 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:42.358327 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6c8710b2-733e-4441-9abf-101de094971e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:42.359338 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6c8710b2-733e-4441-9abf-101de094971e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:42.370603 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6c8710b2-733e-4441-9abf-101de094971e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:42.371433 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6c8710b2-733e-4441-9abf-101de094971e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:42.372233 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6c8710b2-733e-4441-9abf-101de094971e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:42.373880 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6c8710b2-733e-4441-9abf-101de094971e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:42.374693 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6c8710b2-733e-4441-9abf-101de094971e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:42.375464 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6c8710b2-733e-4441-9abf-101de094971e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:42.533349 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6c8710b2-733e-4441-9abf-101de094971e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:42.541173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6c8710b2-733e-4441-9abf-101de094971e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.188186 Aug 31 11:08:42.542281 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 252/459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:42 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:08:43.355435 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5ca35d7d-4692-47f5-924b-8a95d0624088 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:43.356063 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-5ca35d7d-4692-47f5-924b-8a95d0624088 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:43.361917 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5ca35d7d-4692-47f5-924b-8a95d0624088 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:43.362385 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5ca35d7d-4692-47f5-924b-8a95d0624088 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:43.362810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5ca35d7d-4692-47f5-924b-8a95d0624088 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:43.363550 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5ca35d7d-4692-47f5-924b-8a95d0624088 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:43.364037 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5ca35d7d-4692-47f5-924b-8a95d0624088 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:43.364478 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5ca35d7d-4692-47f5-924b-8a95d0624088 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:43.507336 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5ca35d7d-4692-47f5-924b-8a95d0624088 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:43.518526 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5ca35d7d-4692-47f5-924b-8a95d0624088 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:43.519999 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5ca35d7d-4692-47f5-924b-8a95d0624088 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:43.521894 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-5ca35d7d-4692-47f5-924b-8a95d0624088 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.170269 Aug 31 11:08:43.522493 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 208/460] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:43 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:43.565099 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0af3c87c-d683-49ba-8342-9fb2982187b2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:43.565806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-0af3c87c-d683-49ba-8342-9fb2982187b2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:43.572617 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0af3c87c-d683-49ba-8342-9fb2982187b2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:43.573111 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0af3c87c-d683-49ba-8342-9fb2982187b2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:43.573704 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0af3c87c-d683-49ba-8342-9fb2982187b2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:43.574238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0af3c87c-d683-49ba-8342-9fb2982187b2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:43.574695 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0af3c87c-d683-49ba-8342-9fb2982187b2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:43.575120 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0af3c87c-d683-49ba-8342-9fb2982187b2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:43.717063 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0af3c87c-d683-49ba-8342-9fb2982187b2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:43.725694 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0af3c87c-d683-49ba-8342-9fb2982187b2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1259 microversion: 2.1 time: 0.164296 Aug 31 11:08:43.726234 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 253/461] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:43 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:44.545871 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3ce062fc-0add-43bc-b923-ab345f7ddd52 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:44.546576 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3ce062fc-0add-43bc-b923-ab345f7ddd52 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:44.553722 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ce062fc-0add-43bc-b923-ab345f7ddd52 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:44.554694 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ce062fc-0add-43bc-b923-ab345f7ddd52 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:44.555546 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ce062fc-0add-43bc-b923-ab345f7ddd52 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:44.556452 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ce062fc-0add-43bc-b923-ab345f7ddd52 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:44.556982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ce062fc-0add-43bc-b923-ab345f7ddd52 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:44.557479 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ce062fc-0add-43bc-b923-ab345f7ddd52 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:44.706956 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3ce062fc-0add-43bc-b923-ab345f7ddd52 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:44.716663 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3ce062fc-0add-43bc-b923-ab345f7ddd52 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:44.718044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3ce062fc-0add-43bc-b923-ab345f7ddd52 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:44.719272 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3ce062fc-0add-43bc-b923-ab345f7ddd52 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.177857 Aug 31 11:08:44.719897 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 209/462] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:44 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:08:44.746433 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-153ab88c-d6e9-48e9-b1a8-a5cdce32ecb9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:44.747137 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-153ab88c-d6e9-48e9-b1a8-a5cdce32ecb9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:44.755553 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-153ab88c-d6e9-48e9-b1a8-a5cdce32ecb9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:44.756143 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-153ab88c-d6e9-48e9-b1a8-a5cdce32ecb9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:44.756518 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-153ab88c-d6e9-48e9-b1a8-a5cdce32ecb9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:44.757257 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-153ab88c-d6e9-48e9-b1a8-a5cdce32ecb9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:44.757706 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-153ab88c-d6e9-48e9-b1a8-a5cdce32ecb9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:44.758128 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-153ab88c-d6e9-48e9-b1a8-a5cdce32ecb9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:44.906264 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-153ab88c-d6e9-48e9-b1a8-a5cdce32ecb9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:44.914893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-153ab88c-d6e9-48e9-b1a8-a5cdce32ecb9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1443 microversion: 2.1 time: 0.172421 Aug 31 11:08:44.915503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 254/463] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:44 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1443 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:44.936433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-aa94b840-b49d-46a8-9a5e-01c68b4779eb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:44.937031 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-aa94b840-b49d-46a8-9a5e-01c68b4779eb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:44.943082 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aa94b840-b49d-46a8-9a5e-01c68b4779eb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:44.943552 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aa94b840-b49d-46a8-9a5e-01c68b4779eb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:44.943979 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aa94b840-b49d-46a8-9a5e-01c68b4779eb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:44.944684 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aa94b840-b49d-46a8-9a5e-01c68b4779eb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:44.945123 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aa94b840-b49d-46a8-9a5e-01c68b4779eb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:44.945534 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aa94b840-b49d-46a8-9a5e-01c68b4779eb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:45.075340 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-aa94b840-b49d-46a8-9a5e-01c68b4779eb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:45.083550 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-aa94b840-b49d-46a8-9a5e-01c68b4779eb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1443 microversion: 2.1 time: 0.151003 Aug 31 11:08:45.084239 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 210/464] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:44 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:08:45.743547 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ae2edc6f-da65-4ace-968e-eb79ab452ce8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:45.744191 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ae2edc6f-da65-4ace-968e-eb79ab452ce8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:45.751031 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ae2edc6f-da65-4ace-968e-eb79ab452ce8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:45.751663 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ae2edc6f-da65-4ace-968e-eb79ab452ce8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:45.752123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ae2edc6f-da65-4ace-968e-eb79ab452ce8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:45.752851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ae2edc6f-da65-4ace-968e-eb79ab452ce8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:45.753303 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ae2edc6f-da65-4ace-968e-eb79ab452ce8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:45.753725 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ae2edc6f-da65-4ace-968e-eb79ab452ce8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:46.032724 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ae2edc6f-da65-4ace-968e-eb79ab452ce8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:46.035634 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=100 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:46.048853 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ae2edc6f-da65-4ace-968e-eb79ab452ce8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:46.052531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ae2edc6f-da65-4ace-968e-eb79ab452ce8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:46.055428 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ae2edc6f-da65-4ace-968e-eb79ab452ce8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.316153 Aug 31 11:08:46.057605 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 255/465] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:45 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:47.001021 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-5bfaf1c0-dc71-4795-b043-1443c5b4ca48 req-c8566c48-b08d-40a0-81d0-f345c021827b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2a8d50-fa16-40f4-9760-25603efd4d6d", "tag": "e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:47.011495 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5bfaf1c0-dc71-4795-b043-1443c5b4ca48 req-c8566c48-b08d-40a0-81d0-f345c021827b service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:47.012093 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5bfaf1c0-dc71-4795-b043-1443c5b4ca48 req-c8566c48-b08d-40a0-81d0-f345c021827b service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:47.012587 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5bfaf1c0-dc71-4795-b043-1443c5b4ca48 req-c8566c48-b08d-40a0-81d0-f345c021827b service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:47.024983 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-5bfaf1c0-dc71-4795-b043-1443c5b4ca48 req-c8566c48-b08d-40a0-81d0-f345c021827b service nova] Creating event network-changed:e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13 for instance dd2a8d50-fa16-40f4-9760-25603efd4d6d on hv-cinder-85535 Aug 31 11:08:47.029984 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-5bfaf1c0-dc71-4795-b043-1443c5b4ca48 req-c8566c48-b08d-40a0-81d0-f345c021827b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032652 Aug 31 11:08:47.030592 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 211/466] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:08:47.095032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e370f432-891c-4051-a5a9-6b5ceb723986 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:47.095636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e370f432-891c-4051-a5a9-6b5ceb723986 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:47.104072 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e370f432-891c-4051-a5a9-6b5ceb723986 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:47.104572 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e370f432-891c-4051-a5a9-6b5ceb723986 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:47.105084 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e370f432-891c-4051-a5a9-6b5ceb723986 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:47.106317 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e370f432-891c-4051-a5a9-6b5ceb723986 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:47.106890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e370f432-891c-4051-a5a9-6b5ceb723986 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:47.107313 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e370f432-891c-4051-a5a9-6b5ceb723986 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:47.243332 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e370f432-891c-4051-a5a9-6b5ceb723986 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:47.253541 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e370f432-891c-4051-a5a9-6b5ceb723986 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:47.255143 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e370f432-891c-4051-a5a9-6b5ceb723986 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:47.256527 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e370f432-891c-4051-a5a9-6b5ceb723986 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.165486 Aug 31 11:08:47.257764 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 256/467] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:47 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:48.281299 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4273860b-d107-46fb-8a20-5653a85171f9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:48.281895 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-4273860b-d107-46fb-8a20-5653a85171f9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:48.288768 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4273860b-d107-46fb-8a20-5653a85171f9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:48.289295 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4273860b-d107-46fb-8a20-5653a85171f9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:48.289728 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4273860b-d107-46fb-8a20-5653a85171f9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:48.290421 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4273860b-d107-46fb-8a20-5653a85171f9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:48.290869 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4273860b-d107-46fb-8a20-5653a85171f9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:48.291289 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4273860b-d107-46fb-8a20-5653a85171f9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:48.431332 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4273860b-d107-46fb-8a20-5653a85171f9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:48.439940 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4273860b-d107-46fb-8a20-5653a85171f9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:48.441404 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4273860b-d107-46fb-8a20-5653a85171f9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:48.442562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4273860b-d107-46fb-8a20-5653a85171f9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.165651 Aug 31 11:08:48.443119 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 212/468] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:48 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:49.465314 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-419993aa-7e12-42ad-bcad-1b97d79bb6f6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:49.465905 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-419993aa-7e12-42ad-bcad-1b97d79bb6f6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:49.472256 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-419993aa-7e12-42ad-bcad-1b97d79bb6f6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:49.472730 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-419993aa-7e12-42ad-bcad-1b97d79bb6f6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:49.473903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-419993aa-7e12-42ad-bcad-1b97d79bb6f6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:49.474593 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-419993aa-7e12-42ad-bcad-1b97d79bb6f6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:49.475036 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-419993aa-7e12-42ad-bcad-1b97d79bb6f6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:49.475450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-419993aa-7e12-42ad-bcad-1b97d79bb6f6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:49.610735 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-419993aa-7e12-42ad-bcad-1b97d79bb6f6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:49.619663 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-419993aa-7e12-42ad-bcad-1b97d79bb6f6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:49.621165 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-419993aa-7e12-42ad-bcad-1b97d79bb6f6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:49.622358 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-419993aa-7e12-42ad-bcad-1b97d79bb6f6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.160859 Aug 31 11:08:49.622911 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 257/469] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:49 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:50.646402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7e4a8299-5442-46f0-8c79-668cc9905d87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:50.647033 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-7e4a8299-5442-46f0-8c79-668cc9905d87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:50.653594 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7e4a8299-5442-46f0-8c79-668cc9905d87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:50.654080 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7e4a8299-5442-46f0-8c79-668cc9905d87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:50.654515 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7e4a8299-5442-46f0-8c79-668cc9905d87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:50.655209 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7e4a8299-5442-46f0-8c79-668cc9905d87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:50.655664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7e4a8299-5442-46f0-8c79-668cc9905d87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:50.656115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7e4a8299-5442-46f0-8c79-668cc9905d87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:50.789986 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7e4a8299-5442-46f0-8c79-668cc9905d87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:50.799532 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7e4a8299-5442-46f0-8c79-668cc9905d87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:50.801960 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7e4a8299-5442-46f0-8c79-668cc9905d87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:50.803136 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7e4a8299-5442-46f0-8c79-668cc9905d87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.161510 Aug 31 11:08:50.803940 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 213/470] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:50 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:51.826634 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0f2f95c9-9f9e-4ac3-943b-019e57ef0be1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:51.827240 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-0f2f95c9-9f9e-4ac3-943b-019e57ef0be1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:51.833956 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0f2f95c9-9f9e-4ac3-943b-019e57ef0be1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:51.834436 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0f2f95c9-9f9e-4ac3-943b-019e57ef0be1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:51.834873 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0f2f95c9-9f9e-4ac3-943b-019e57ef0be1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:51.835565 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0f2f95c9-9f9e-4ac3-943b-019e57ef0be1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:51.836033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0f2f95c9-9f9e-4ac3-943b-019e57ef0be1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:51.836459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0f2f95c9-9f9e-4ac3-943b-019e57ef0be1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:51.967004 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0f2f95c9-9f9e-4ac3-943b-019e57ef0be1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:51.975919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0f2f95c9-9f9e-4ac3-943b-019e57ef0be1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:51.977392 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0f2f95c9-9f9e-4ac3-943b-019e57ef0be1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:51.978555 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0f2f95c9-9f9e-4ac3-943b-019e57ef0be1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.155870 Aug 31 11:08:51.979103 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 258/471] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:51 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:53.002968 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5e3c81b2-b406-4c4d-8590-c80602e9ea3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:53.003723 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-5e3c81b2-b406-4c4d-8590-c80602e9ea3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:53.010238 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5e3c81b2-b406-4c4d-8590-c80602e9ea3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:53.011059 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5e3c81b2-b406-4c4d-8590-c80602e9ea3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:53.011498 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5e3c81b2-b406-4c4d-8590-c80602e9ea3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:53.012237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5e3c81b2-b406-4c4d-8590-c80602e9ea3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:53.012688 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5e3c81b2-b406-4c4d-8590-c80602e9ea3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:53.013108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5e3c81b2-b406-4c4d-8590-c80602e9ea3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:53.147987 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5e3c81b2-b406-4c4d-8590-c80602e9ea3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:53.156755 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5e3c81b2-b406-4c4d-8590-c80602e9ea3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:53.158197 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5e3c81b2-b406-4c4d-8590-c80602e9ea3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:53.159354 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-5e3c81b2-b406-4c4d-8590-c80602e9ea3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.160867 Aug 31 11:08:53.159911 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 214/472] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:52 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:54.183966 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4ef0ebc5-07b2-4a3b-bf0a-5368ab03e80c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:54.184500 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4ef0ebc5-07b2-4a3b-bf0a-5368ab03e80c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:54.191135 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ef0ebc5-07b2-4a3b-bf0a-5368ab03e80c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:54.191670 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ef0ebc5-07b2-4a3b-bf0a-5368ab03e80c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:54.192123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ef0ebc5-07b2-4a3b-bf0a-5368ab03e80c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:54.192818 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ef0ebc5-07b2-4a3b-bf0a-5368ab03e80c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:54.193264 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ef0ebc5-07b2-4a3b-bf0a-5368ab03e80c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:54.193681 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ef0ebc5-07b2-4a3b-bf0a-5368ab03e80c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:54.329419 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4ef0ebc5-07b2-4a3b-bf0a-5368ab03e80c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:54.338408 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4ef0ebc5-07b2-4a3b-bf0a-5368ab03e80c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:54.339856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4ef0ebc5-07b2-4a3b-bf0a-5368ab03e80c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:54.341047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4ef0ebc5-07b2-4a3b-bf0a-5368ab03e80c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.161065 Aug 31 11:08:54.341606 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 259/473] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:54 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:08:55.365439 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e316a9d0-c0da-4330-88fa-e3d4c8ba4de4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:55.366035 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e316a9d0-c0da-4330-88fa-e3d4c8ba4de4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:55.372267 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e316a9d0-c0da-4330-88fa-e3d4c8ba4de4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:55.372739 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e316a9d0-c0da-4330-88fa-e3d4c8ba4de4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:55.373173 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e316a9d0-c0da-4330-88fa-e3d4c8ba4de4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:55.373858 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e316a9d0-c0da-4330-88fa-e3d4c8ba4de4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:55.374292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e316a9d0-c0da-4330-88fa-e3d4c8ba4de4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:55.374708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e316a9d0-c0da-4330-88fa-e3d4c8ba4de4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:55.513037 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e316a9d0-c0da-4330-88fa-e3d4c8ba4de4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:55.516579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=100 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:55.526189 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e316a9d0-c0da-4330-88fa-e3d4c8ba4de4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:55.527943 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e316a9d0-c0da-4330-88fa-e3d4c8ba4de4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:55.529368 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e316a9d0-c0da-4330-88fa-e3d4c8ba4de4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.167732 Aug 31 11:08:55.529931 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 215/474] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:55 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:08:55.608488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8cb668d6-9ac4-4518-b7e6-2dada3c063d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:55.609065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8cb668d6-9ac4-4518-b7e6-2dada3c063d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:55.615812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8cb668d6-9ac4-4518-b7e6-2dada3c063d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:55.616334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8cb668d6-9ac4-4518-b7e6-2dada3c063d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:55.616762 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8cb668d6-9ac4-4518-b7e6-2dada3c063d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:55.617508 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8cb668d6-9ac4-4518-b7e6-2dada3c063d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:55.618006 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8cb668d6-9ac4-4518-b7e6-2dada3c063d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:55.618472 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8cb668d6-9ac4-4518-b7e6-2dada3c063d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:55.641663 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8cb668d6-9ac4-4518-b7e6-2dada3c063d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/ips" status: 200 len: 146 microversion: 2.1 time: 0.036986 Aug 31 11:08:55.642235 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 260/475] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 11:08:55 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:08:56.553457 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-41687fe9-9c3d-4742-ae27-2b93f0f8328a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:56.554018 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-41687fe9-9c3d-4742-ae27-2b93f0f8328a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:56.560158 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41687fe9-9c3d-4742-ae27-2b93f0f8328a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:56.560633 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41687fe9-9c3d-4742-ae27-2b93f0f8328a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:56.561059 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41687fe9-9c3d-4742-ae27-2b93f0f8328a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:56.561745 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41687fe9-9c3d-4742-ae27-2b93f0f8328a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:56.562189 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41687fe9-9c3d-4742-ae27-2b93f0f8328a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:56.562601 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41687fe9-9c3d-4742-ae27-2b93f0f8328a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:56.709999 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-41687fe9-9c3d-4742-ae27-2b93f0f8328a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:56.719093 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-41687fe9-9c3d-4742-ae27-2b93f0f8328a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:56.720557 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-41687fe9-9c3d-4742-ae27-2b93f0f8328a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:56.721723 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-41687fe9-9c3d-4742-ae27-2b93f0f8328a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.173108 Aug 31 11:08:56.722274 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 216/476] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:56 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:57.745736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-156ec989-a5f9-4925-8c1f-cf4e91eb569a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:57.746405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-156ec989-a5f9-4925-8c1f-cf4e91eb569a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:57.748705 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=46 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:08:57.753849 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-156ec989-a5f9-4925-8c1f-cf4e91eb569a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:57.754332 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-156ec989-a5f9-4925-8c1f-cf4e91eb569a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:57.754759 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-156ec989-a5f9-4925-8c1f-cf4e91eb569a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:57.755442 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-156ec989-a5f9-4925-8c1f-cf4e91eb569a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:57.755886 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-156ec989-a5f9-4925-8c1f-cf4e91eb569a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:57.756337 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-156ec989-a5f9-4925-8c1f-cf4e91eb569a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:57.888160 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-156ec989-a5f9-4925-8c1f-cf4e91eb569a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:57.897522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-156ec989-a5f9-4925-8c1f-cf4e91eb569a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:57.898962 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-156ec989-a5f9-4925-8c1f-cf4e91eb569a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:57.900164 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-156ec989-a5f9-4925-8c1f-cf4e91eb569a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.158341 Aug 31 11:08:57.900723 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 261/477] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:57 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:58.246750 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-4d46d0d2-79d7-4e53-a427-5a8c0862dcdf req-1c8ffd38-098d-4f6a-b8fa-2238f0d19323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e", "name": "network-vif-plugged", "status": "completed", "tag": "a2414d6d-8b79-405f-a378-ffbb986542cb"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:58.258298 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-4d46d0d2-79d7-4e53-a427-5a8c0862dcdf req-1c8ffd38-098d-4f6a-b8fa-2238f0d19323 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:58.258785 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-4d46d0d2-79d7-4e53-a427-5a8c0862dcdf req-1c8ffd38-098d-4f6a-b8fa-2238f0d19323 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:58.259215 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-4d46d0d2-79d7-4e53-a427-5a8c0862dcdf req-1c8ffd38-098d-4f6a-b8fa-2238f0d19323 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:58.271340 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-4d46d0d2-79d7-4e53-a427-5a8c0862dcdf req-1c8ffd38-098d-4f6a-b8fa-2238f0d19323 service nova] Creating event network-vif-plugged:a2414d6d-8b79-405f-a378-ffbb986542cb for instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e on hv-cinder-85535 Aug 31 11:08:58.301916 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-4d46d0d2-79d7-4e53-a427-5a8c0862dcdf req-1c8ffd38-098d-4f6a-b8fa-2238f0d19323 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059180 Aug 31 11:08:58.302809 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 217/478] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:08:58.924335 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1e95d215-1466-4f3a-9b51-305c465d7165 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:58.924999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1e95d215-1466-4f3a-9b51-305c465d7165 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:58.931805 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e95d215-1466-4f3a-9b51-305c465d7165 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:58.932325 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e95d215-1466-4f3a-9b51-305c465d7165 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:58.932757 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e95d215-1466-4f3a-9b51-305c465d7165 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:58.933521 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e95d215-1466-4f3a-9b51-305c465d7165 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:58.933969 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e95d215-1466-4f3a-9b51-305c465d7165 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:58.934385 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e95d215-1466-4f3a-9b51-305c465d7165 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:59.067191 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-1e95d215-1466-4f3a-9b51-305c465d7165 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:59.075835 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-1e95d215-1466-4f3a-9b51-305c465d7165 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:59.077314 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-1e95d215-1466-4f3a-9b51-305c465d7165 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:08:59.078478 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1e95d215-1466-4f3a-9b51-305c465d7165 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.158646 Aug 31 11:08:59.079034 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 262/479] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:08:58 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:08:59.439350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6980107d-76d5-429f-93d4-134af1548ec7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "380d061b-e819-495b-b58b-36abed3556bd"}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:59.442633 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6980107d-76d5-429f-93d4-134af1548ec7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:59.448767 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6980107d-76d5-429f-93d4-134af1548ec7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:59.449246 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6980107d-76d5-429f-93d4-134af1548ec7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:59.449679 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6980107d-76d5-429f-93d4-134af1548ec7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:59.450370 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6980107d-76d5-429f-93d4-134af1548ec7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:59.450817 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6980107d-76d5-429f-93d4-134af1548ec7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:59.451237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6980107d-76d5-429f-93d4-134af1548ec7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:59.573261 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1de5bf1c-d61b-422b-a4df-27680fb2ade4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:59.573742 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1de5bf1c-d61b-422b-a4df-27680fb2ade4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:59.579853 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1de5bf1c-d61b-422b-a4df-27680fb2ade4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:59.580370 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1de5bf1c-d61b-422b-a4df-27680fb2ade4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:59.580805 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1de5bf1c-d61b-422b-a4df-27680fb2ade4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:59.581506 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1de5bf1c-d61b-422b-a4df-27680fb2ade4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:59.582575 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1de5bf1c-d61b-422b-a4df-27680fb2ade4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:59.582996 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1de5bf1c-d61b-422b-a4df-27680fb2ade4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:59.609004 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1de5bf1c-d61b-422b-a4df-27680fb2ade4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845/ips" status: 200 len: 147 microversion: 2.1 time: 0.039527 Aug 31 11:08:59.609563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 263/480] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 11:08:59 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:08:59.620619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-93b3e23f-55aa-44d4-8b45-d06ade4fee25 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "546a7f08-1bd1-4d9b-b7bc-95db1189f768"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:08:59.622938 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-93b3e23f-55aa-44d4-8b45-d06ade4fee25 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:59.629318 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-93b3e23f-55aa-44d4-8b45-d06ade4fee25 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:59.629880 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-93b3e23f-55aa-44d4-8b45-d06ade4fee25 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:59.630317 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-93b3e23f-55aa-44d4-8b45-d06ade4fee25 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:59.631001 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-93b3e23f-55aa-44d4-8b45-d06ade4fee25 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:59.631453 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-93b3e23f-55aa-44d4-8b45-d06ade4fee25 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:59.631869 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-93b3e23f-55aa-44d4-8b45-d06ade4fee25 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:59.712289 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-93b3e23f-55aa-44d4-8b45-d06ade4fee25 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Invalid volume: volume 546a7f08-1bd1-4d9b-b7bc-95db1189f768 is already attached to instances: a9af9ee9-af17-4f68-bb4a-dcebd9827b12 Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-93b3e23f-55aa-44d4-8b45-d06ade4fee25 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: POST /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845/os-volume_attachments HTTP/1.1 Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 74 Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:08:59.714048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:08:59.715563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:08:59.715563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:08:59.715563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:08:59.715563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:08:59.715563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:08:59.715563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:08:59.715563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:08:59.715563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:08:59.715563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:08:59.715563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Aug 31 11:08:59.715563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {"volumeAttachment": {"volumeId": "546a7f08-1bd1-4d9b-b7bc-95db1189f768"}} Aug 31 11:08:59.715563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Invalid volume: volume 546a7f08-1bd1-4d9b-b7bc-95db1189f768 is already attached to instances: a9af9ee9-af17-4f68-bb4a-dcebd9827b12 Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'server_id': '962f8405-fd3a-4f34-92de-a437bdcb7845', 'body': {'volumeAttachment': {'volumeId': '546a7f08-1bd1-4d9b-b7bc-95db1189f768'}}} Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 546a7f08-1bd1-4d9b-b7bc-95db1189f768 is already attached to instances: a9af9ee9-af17-4f68-bb4a-dcebd9827b12 Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:08:59.716736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 546a7f08-1bd1-4d9b-b7bc-95db1189f768 is already attached to instances: a9af9ee9-af17-4f68-bb4a-dcebd9827b12 Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:08:59.718206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:08:59.719654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:08:59.719654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:08:59.719654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:08:59.719654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 546a7f08-1bd1-4d9b-b7bc-95db1189f768 is already attached to instances: a9af9ee9-af17-4f68-bb4a-dcebd9827b12 Aug 31 11:08:59.719654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:08:59.719654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-93b3e23f-55aa-44d4-8b45-d06ade4fee25 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 400 to user: Invalid volume: volume 546a7f08-1bd1-4d9b-b7bc-95db1189f768 is already attached to instances: a9af9ee9-af17-4f68-bb4a-dcebd9827b12 {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:08:59.719654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-93b3e23f-55aa-44d4-8b45-d06ade4fee25 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098595 Aug 31 11:08:59.719654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 264/481] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:08:59 2022] POST /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 11:08:59.724191 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a7d72eb2-a30e-4cce-813d-b1ddb1ce7c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:59.724687 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a7d72eb2-a30e-4cce-813d-b1ddb1ce7c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:59.730709 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7d72eb2-a30e-4cce-813d-b1ddb1ce7c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:59.731194 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7d72eb2-a30e-4cce-813d-b1ddb1ce7c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:59.731629 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7d72eb2-a30e-4cce-813d-b1ddb1ce7c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:59.732356 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7d72eb2-a30e-4cce-813d-b1ddb1ce7c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:59.732805 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7d72eb2-a30e-4cce-813d-b1ddb1ce7c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:59.733230 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7d72eb2-a30e-4cce-813d-b1ddb1ce7c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:59.759585 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a7d72eb2-a30e-4cce-813d-b1ddb1ce7c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:08:59.837915 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a7d72eb2-a30e-4cce-813d-b1ddb1ce7c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 204 len: 0 microversion: 2.1 time: 0.117215 Aug 31 11:08:59.838503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 265/482] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:08:59 2022] DELETE /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:08:59.847010 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-614a41a8-137d-404b-9e2b-9ca2fe178b9b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:08:59.847888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-614a41a8-137d-404b-9e2b-9ca2fe178b9b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:08:59.853731 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-614a41a8-137d-404b-9e2b-9ca2fe178b9b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:59.854206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-614a41a8-137d-404b-9e2b-9ca2fe178b9b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:59.854634 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-614a41a8-137d-404b-9e2b-9ca2fe178b9b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:08:59.855321 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-614a41a8-137d-404b-9e2b-9ca2fe178b9b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:08:59.855765 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-614a41a8-137d-404b-9e2b-9ca2fe178b9b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:08:59.856220 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-614a41a8-137d-404b-9e2b-9ca2fe178b9b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:00.000307 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-614a41a8-137d-404b-9e2b-9ca2fe178b9b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:00.008755 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-614a41a8-137d-404b-9e2b-9ca2fe178b9b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1679 microversion: 2.1 time: 0.165767 Aug 31 11:09:00.009312 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 266/483] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:08:59 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:00.102696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-66d01ac9-898a-487a-b4f2-f3c827f3d619 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:00.103211 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-66d01ac9-898a-487a-b4f2-f3c827f3d619 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:00.109139 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66d01ac9-898a-487a-b4f2-f3c827f3d619 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:00.109616 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66d01ac9-898a-487a-b4f2-f3c827f3d619 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:00.110043 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66d01ac9-898a-487a-b4f2-f3c827f3d619 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:00.110722 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66d01ac9-898a-487a-b4f2-f3c827f3d619 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:00.111167 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66d01ac9-898a-487a-b4f2-f3c827f3d619 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:00.111582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66d01ac9-898a-487a-b4f2-f3c827f3d619 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:00.242512 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-66d01ac9-898a-487a-b4f2-f3c827f3d619 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:00.250879 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-66d01ac9-898a-487a-b4f2-f3c827f3d619 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:00.252326 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-66d01ac9-898a-487a-b4f2-f3c827f3d619 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:00.253474 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-66d01ac9-898a-487a-b4f2-f3c827f3d619 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.154771 Aug 31 11:09:00.254667 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 267/484] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:09:00 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:09:01.029590 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ccb514db-9e62-4789-b729-edd49688436a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:01.030226 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ccb514db-9e62-4789-b729-edd49688436a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:01.037683 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ccb514db-9e62-4789-b729-edd49688436a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:01.038107 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ccb514db-9e62-4789-b729-edd49688436a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:01.038543 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ccb514db-9e62-4789-b729-edd49688436a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:01.039236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ccb514db-9e62-4789-b729-edd49688436a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:01.039685 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ccb514db-9e62-4789-b729-edd49688436a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:01.040142 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ccb514db-9e62-4789-b729-edd49688436a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:01.172504 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ccb514db-9e62-4789-b729-edd49688436a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:01.180847 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ccb514db-9e62-4789-b729-edd49688436a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1679 microversion: 2.1 time: 0.155055 Aug 31 11:09:01.181405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 268/485] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:01 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:01.277973 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e5bf0466-5de3-4f17-975f-e5d40ff32161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:01.278577 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e5bf0466-5de3-4f17-975f-e5d40ff32161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:01.284463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e5bf0466-5de3-4f17-975f-e5d40ff32161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:01.285442 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e5bf0466-5de3-4f17-975f-e5d40ff32161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:01.285872 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e5bf0466-5de3-4f17-975f-e5d40ff32161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:01.286565 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e5bf0466-5de3-4f17-975f-e5d40ff32161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:01.287006 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e5bf0466-5de3-4f17-975f-e5d40ff32161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:01.287418 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e5bf0466-5de3-4f17-975f-e5d40ff32161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:01.420725 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e5bf0466-5de3-4f17-975f-e5d40ff32161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:01.429387 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e5bf0466-5de3-4f17-975f-e5d40ff32161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:01.430823 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e5bf0466-5de3-4f17-975f-e5d40ff32161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:01.431985 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e5bf0466-5de3-4f17-975f-e5d40ff32161 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1810 microversion: 2.20 time: 0.158057 Aug 31 11:09:01.432579 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 269/486] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:09:01 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:09:01.682083 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6980107d-76d5-429f-93d4-134af1548ec7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "POST /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.246828 Aug 31 11:09:01.683093 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 218/487] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:08:59 2022] POST /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/os-volume_attachments => generated 194 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:09:02.201881 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2bb2de77-8eec-4a04-a6ab-b20d0e4c692a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:02.203116 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2bb2de77-8eec-4a04-a6ab-b20d0e4c692a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:02.210001 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2bb2de77-8eec-4a04-a6ab-b20d0e4c692a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:02.210490 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2bb2de77-8eec-4a04-a6ab-b20d0e4c692a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:02.210921 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2bb2de77-8eec-4a04-a6ab-b20d0e4c692a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:02.211616 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2bb2de77-8eec-4a04-a6ab-b20d0e4c692a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:02.212095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2bb2de77-8eec-4a04-a6ab-b20d0e4c692a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:02.212715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2bb2de77-8eec-4a04-a6ab-b20d0e4c692a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:02.353296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2bb2de77-8eec-4a04-a6ab-b20d0e4c692a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:02.365750 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2bb2de77-8eec-4a04-a6ab-b20d0e4c692a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1679 microversion: 2.1 time: 0.167585 Aug 31 11:09:02.366400 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 270/488] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:02 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:02.455753 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6f1db29e-311f-4b36-b4b4-d1dd99548a0b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:02.456280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6f1db29e-311f-4b36-b4b4-d1dd99548a0b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:02.464483 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6f1db29e-311f-4b36-b4b4-d1dd99548a0b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:02.464483 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6f1db29e-311f-4b36-b4b4-d1dd99548a0b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:02.464799 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6f1db29e-311f-4b36-b4b4-d1dd99548a0b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:02.465393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6f1db29e-311f-4b36-b4b4-d1dd99548a0b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:02.465850 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6f1db29e-311f-4b36-b4b4-d1dd99548a0b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:02.466277 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6f1db29e-311f-4b36-b4b4-d1dd99548a0b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:02.994563 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6f1db29e-311f-4b36-b4b4-d1dd99548a0b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:03.003232 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6f1db29e-311f-4b36-b4b4-d1dd99548a0b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:03.005511 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6f1db29e-311f-4b36-b4b4-d1dd99548a0b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:03.006661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6f1db29e-311f-4b36-b4b4-d1dd99548a0b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1797 microversion: 2.20 time: 0.555454 Aug 31 11:09:03.007218 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 219/489] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:09:02 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1797 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:09:03.393386 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6da9edb0-2615-4d4a-9d7a-b169ffc6f59f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:03.393942 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6da9edb0-2615-4d4a-9d7a-b169ffc6f59f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:03.401257 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6da9edb0-2615-4d4a-9d7a-b169ffc6f59f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:03.401721 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6da9edb0-2615-4d4a-9d7a-b169ffc6f59f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:03.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6da9edb0-2615-4d4a-9d7a-b169ffc6f59f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:03.402849 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6da9edb0-2615-4d4a-9d7a-b169ffc6f59f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:03.403302 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6da9edb0-2615-4d4a-9d7a-b169ffc6f59f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:03.404391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6da9edb0-2615-4d4a-9d7a-b169ffc6f59f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:03.420381 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:03.484566 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6da9edb0-2615-4d4a-9d7a-b169ffc6f59f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:03.494582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6da9edb0-2615-4d4a-9d7a-b169ffc6f59f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 200 len: 1611 microversion: 2.1 time: 0.105370 Aug 31 11:09:03.495397 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 271/490] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:03 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 1611 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:03.616882 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-8e70c45e-a2dc-4a41-b434-000d2a94549a req-2e881449-b71f-4d24-bc05-36f8ff8405bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962f8405-fd3a-4f34-92de-a437bdcb7845", "name": "network-vif-deleted", "tag": "e7ff85c2-9219-4680-b3cd-1a1d113ea478"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:03.623540 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=42 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:03.628404 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-8e70c45e-a2dc-4a41-b434-000d2a94549a req-2e881449-b71f-4d24-bc05-36f8ff8405bf service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:03.629259 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-8e70c45e-a2dc-4a41-b434-000d2a94549a req-2e881449-b71f-4d24-bc05-36f8ff8405bf service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:03.629791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-8e70c45e-a2dc-4a41-b434-000d2a94549a req-2e881449-b71f-4d24-bc05-36f8ff8405bf service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:03.644560 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-8e70c45e-a2dc-4a41-b434-000d2a94549a req-2e881449-b71f-4d24-bc05-36f8ff8405bf service nova] Creating event network-vif-deleted:e7ff85c2-9219-4680-b3cd-1a1d113ea478 for instance 962f8405-fd3a-4f34-92de-a437bdcb7845 on hv-cinder-85535 Aug 31 11:09:03.649661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-8e70c45e-a2dc-4a41-b434-000d2a94549a req-2e881449-b71f-4d24-bc05-36f8ff8405bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036526 Aug 31 11:09:03.650393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 220/491] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:04.518492 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4ad43192-7c8a-492f-98a2-80b7d57206d0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:04.520217 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4ad43192-7c8a-492f-98a2-80b7d57206d0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:04.526693 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ad43192-7c8a-492f-98a2-80b7d57206d0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:04.527185 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ad43192-7c8a-492f-98a2-80b7d57206d0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:04.527619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ad43192-7c8a-492f-98a2-80b7d57206d0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:04.528456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ad43192-7c8a-492f-98a2-80b7d57206d0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:04.528910 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ad43192-7c8a-492f-98a2-80b7d57206d0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:04.529330 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ad43192-7c8a-492f-98a2-80b7d57206d0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:04.546156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-4ad43192-7c8a-492f-98a2-80b7d57206d0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4ad43192-7c8a-492f-98a2-80b7d57206d0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 HTTP/1.1 Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:09:04.547822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:09:04.549334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:09:04.549334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:09:04.549334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:09:04.549334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:09:04.549334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:09:04.549334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:09:04.549334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:09:04.549334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:09:04.549334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:09:04.549334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:09:04.549334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:09:04.549334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '962f8405-fd3a-4f34-92de-a437bdcb7845'} Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:09:04.550388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:09:04.551749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:09:04.553057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4ad43192-7c8a-492f-98a2-80b7d57206d0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 404 to user: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:09:04.553057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4ad43192-7c8a-492f-98a2-80b7d57206d0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 404 len: 111 microversion: 2.1 time: 0.035454 Aug 31 11:09:04.553057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 272/492] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:04 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:09:04.562763 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-25317259-cdf3-4869-82fd-91256a20dcf8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '.version_select at 0x7f732e227550>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:04.584725 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-25317259-cdf3-4869-82fd-91256a20dcf8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193661226" status: 202 len: 0 microversion: 2.1 time: 0.026399 Aug 31 11:09:04.585471 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 221/493] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 31 11:09:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193661226 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:09:05.332713 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-309923e3-dbc9-490c-bc21-36034c9443e5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:05.333211 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-309923e3-dbc9-490c-bc21-36034c9443e5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:05.339306 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-309923e3-dbc9-490c-bc21-36034c9443e5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:05.339818 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-309923e3-dbc9-490c-bc21-36034c9443e5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:05.340293 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-309923e3-dbc9-490c-bc21-36034c9443e5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:05.340986 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-309923e3-dbc9-490c-bc21-36034c9443e5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:05.341488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-309923e3-dbc9-490c-bc21-36034c9443e5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:05.341937 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-309923e3-dbc9-490c-bc21-36034c9443e5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:05.482646 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-309923e3-dbc9-490c-bc21-36034c9443e5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lazy-loading 'services' on Instance uuid a9af9ee9-af17-4f68-bb4a-dcebd9827b12 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:09:05.612042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-309923e3-dbc9-490c-bc21-36034c9443e5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments/546a7f08-1bd1-4d9b-b7bc-95db1189f768" status: 202 len: 0 microversion: 2.1 time: 0.285173 Aug 31 11:09:05.613671 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 273/494] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 11:09:05 2022] DELETE /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments/546a7f08-1bd1-4d9b-b7bc-95db1189f768 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:09:05.622490 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a58e547d-3172-4436-9686-d1262d32627f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:05.625603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a58e547d-3172-4436-9686-d1262d32627f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:05.634407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a58e547d-3172-4436-9686-d1262d32627f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:05.635394 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a58e547d-3172-4436-9686-d1262d32627f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:05.635843 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a58e547d-3172-4436-9686-d1262d32627f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:05.636610 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a58e547d-3172-4436-9686-d1262d32627f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:05.637069 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a58e547d-3172-4436-9686-d1262d32627f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:05.637665 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a58e547d-3172-4436-9686-d1262d32627f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:05.682675 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a58e547d-3172-4436-9686-d1262d32627f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064735 Aug 31 11:09:05.683334 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 222/495] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:09:05 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:06.697857 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5c675b9d-8d75-4acd-b5c2-f43b283863c0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:06.700200 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5c675b9d-8d75-4acd-b5c2-f43b283863c0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:06.707164 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5c675b9d-8d75-4acd-b5c2-f43b283863c0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:06.707640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5c675b9d-8d75-4acd-b5c2-f43b283863c0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:06.708105 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5c675b9d-8d75-4acd-b5c2-f43b283863c0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:06.708793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5c675b9d-8d75-4acd-b5c2-f43b283863c0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:06.709238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5c675b9d-8d75-4acd-b5c2-f43b283863c0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:06.709653 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5c675b9d-8d75-4acd-b5c2-f43b283863c0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:06.740533 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-5c675b9d-8d75-4acd-b5c2-f43b283863c0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047651 Aug 31 11:09:06.741098 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 274/496] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:09:06 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:07.753015 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8dace3c4-08d8-4acf-bf8c-32109b2030a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:07.755491 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8dace3c4-08d8-4acf-bf8c-32109b2030a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:07.761978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dace3c4-08d8-4acf-bf8c-32109b2030a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:07.762443 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dace3c4-08d8-4acf-bf8c-32109b2030a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:07.762874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dace3c4-08d8-4acf-bf8c-32109b2030a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:07.763563 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dace3c4-08d8-4acf-bf8c-32109b2030a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:07.764030 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dace3c4-08d8-4acf-bf8c-32109b2030a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:07.764448 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8dace3c4-08d8-4acf-bf8c-32109b2030a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:07.795319 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8dace3c4-08d8-4acf-bf8c-32109b2030a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046211 Aug 31 11:09:07.795885 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 223/497] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:09:07 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:08.807406 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b5abf775-229f-4f21-95fa-a8c19ddab380 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:08.809524 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b5abf775-229f-4f21-95fa-a8c19ddab380 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:08.816027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5abf775-229f-4f21-95fa-a8c19ddab380 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:08.816509 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5abf775-229f-4f21-95fa-a8c19ddab380 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:08.816941 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5abf775-229f-4f21-95fa-a8c19ddab380 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:08.817636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5abf775-229f-4f21-95fa-a8c19ddab380 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:08.818084 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5abf775-229f-4f21-95fa-a8c19ddab380 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:08.818506 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5abf775-229f-4f21-95fa-a8c19ddab380 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:08.849145 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b5abf775-229f-4f21-95fa-a8c19ddab380 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045682 Aug 31 11:09:08.849748 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 275/498] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:09:08 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:09.250073 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9c64ba31-acb8-48cf-8c30-5179cdfe5c09 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:09.257406 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c64ba31-acb8-48cf-8c30-5179cdfe5c09 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:09.257897 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c64ba31-acb8-48cf-8c30-5179cdfe5c09 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:09.258324 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9c64ba31-acb8-48cf-8c30-5179cdfe5c09 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:09.321292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-9c64ba31-acb8-48cf-8c30-5179cdfe5c09 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Going to try to stop instance {{(pid=120655) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 11:09:09.365097 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-9c64ba31-acb8-48cf-8c30-5179cdfe5c09 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "POST /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/action" status: 202 len: 0 microversion: 2.1 time: 0.118786 Aug 31 11:09:09.365686 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 224/499] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:09:09 2022] POST /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:09:09.373707 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3628d5a1-735d-42e0-a4b9-6821a87f4a7d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:09.374316 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3628d5a1-735d-42e0-a4b9-6821a87f4a7d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:09.380830 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3628d5a1-735d-42e0-a4b9-6821a87f4a7d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:09.381319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3628d5a1-735d-42e0-a4b9-6821a87f4a7d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:09.381754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3628d5a1-735d-42e0-a4b9-6821a87f4a7d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:09.382515 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3628d5a1-735d-42e0-a4b9-6821a87f4a7d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:09.383196 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3628d5a1-735d-42e0-a4b9-6821a87f4a7d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:09.383620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3628d5a1-735d-42e0-a4b9-6821a87f4a7d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:09.520447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3628d5a1-735d-42e0-a4b9-6821a87f4a7d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:09.528937 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3628d5a1-735d-42e0-a4b9-6821a87f4a7d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.158986 Aug 31 11:09:09.529507 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 276/500] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:09 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:09.862082 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-41cded10-7a87-4d88-a0cc-62c09d85cea3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:09.864806 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-41cded10-7a87-4d88-a0cc-62c09d85cea3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:09.870913 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41cded10-7a87-4d88-a0cc-62c09d85cea3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:09.871384 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41cded10-7a87-4d88-a0cc-62c09d85cea3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:09.871813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41cded10-7a87-4d88-a0cc-62c09d85cea3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:09.872524 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41cded10-7a87-4d88-a0cc-62c09d85cea3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:09.872966 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41cded10-7a87-4d88-a0cc-62c09d85cea3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:09.873381 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41cded10-7a87-4d88-a0cc-62c09d85cea3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:09.903289 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-41cded10-7a87-4d88-a0cc-62c09d85cea3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045500 Aug 31 11:09:09.903845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 225/501] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:09:09 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:10.550908 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b58d9159-59bd-40e4-ae5a-70b93a7e9c25 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:10.551530 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b58d9159-59bd-40e4-ae5a-70b93a7e9c25 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:10.558801 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b58d9159-59bd-40e4-ae5a-70b93a7e9c25 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:10.559283 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b58d9159-59bd-40e4-ae5a-70b93a7e9c25 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:10.559842 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b58d9159-59bd-40e4-ae5a-70b93a7e9c25 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:10.560593 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b58d9159-59bd-40e4-ae5a-70b93a7e9c25 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:10.561037 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b58d9159-59bd-40e4-ae5a-70b93a7e9c25 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:10.561453 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b58d9159-59bd-40e4-ae5a-70b93a7e9c25 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:10.704257 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b58d9159-59bd-40e4-ae5a-70b93a7e9c25 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:10.713273 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b58d9159-59bd-40e4-ae5a-70b93a7e9c25 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.166333 Aug 31 11:09:10.713840 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 277/502] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:10 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:10.915907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e7f428de-7e46-46de-86ba-e4e9c120ef00 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:10.918088 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e7f428de-7e46-46de-86ba-e4e9c120ef00 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:10.924584 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e7f428de-7e46-46de-86ba-e4e9c120ef00 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:10.925118 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e7f428de-7e46-46de-86ba-e4e9c120ef00 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:10.925812 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e7f428de-7e46-46de-86ba-e4e9c120ef00 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:10.926522 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e7f428de-7e46-46de-86ba-e4e9c120ef00 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:10.927002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e7f428de-7e46-46de-86ba-e4e9c120ef00 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:10.927441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e7f428de-7e46-46de-86ba-e4e9c120ef00 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:10.958519 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e7f428de-7e46-46de-86ba-e4e9c120ef00 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046743 Aug 31 11:09:10.959080 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 226/503] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:09:10 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:09:11.021250 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-53cd9249-9156-431a-a03c-690b093b054c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:11.021739 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-53cd9249-9156-431a-a03c-690b093b054c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:11.027610 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53cd9249-9156-431a-a03c-690b093b054c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:11.028125 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53cd9249-9156-431a-a03c-690b093b054c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:11.028561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53cd9249-9156-431a-a03c-690b093b054c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:11.029240 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53cd9249-9156-431a-a03c-690b093b054c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:11.029697 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53cd9249-9156-431a-a03c-690b093b054c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:11.030117 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53cd9249-9156-431a-a03c-690b093b054c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:11.055793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-53cd9249-9156-431a-a03c-690b093b054c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:09:11.143594 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-53cd9249-9156-431a-a03c-690b093b054c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 204 len: 0 microversion: 2.1 time: 0.123360 Aug 31 11:09:11.143594 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 278/504] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:09:11 2022] DELETE /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:09:11.149222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d3c75d17-7b31-4f1f-928b-6db61f001d08 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:11.149863 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d3c75d17-7b31-4f1f-928b-6db61f001d08 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:11.155804 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3c75d17-7b31-4f1f-928b-6db61f001d08 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:11.156311 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3c75d17-7b31-4f1f-928b-6db61f001d08 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:11.156740 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3c75d17-7b31-4f1f-928b-6db61f001d08 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:11.157421 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3c75d17-7b31-4f1f-928b-6db61f001d08 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:11.157868 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3c75d17-7b31-4f1f-928b-6db61f001d08 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:11.158282 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d3c75d17-7b31-4f1f-928b-6db61f001d08 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:11.295543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d3c75d17-7b31-4f1f-928b-6db61f001d08 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:11.303866 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d3c75d17-7b31-4f1f-928b-6db61f001d08 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1681 microversion: 2.1 time: 0.158394 Aug 31 11:09:11.304467 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 227/505] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:11 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:11.734585 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9a0ef655-1e76-42f1-b38a-c8a9b2e36b92 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:11.735281 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9a0ef655-1e76-42f1-b38a-c8a9b2e36b92 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:11.742541 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9a0ef655-1e76-42f1-b38a-c8a9b2e36b92 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:11.743005 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9a0ef655-1e76-42f1-b38a-c8a9b2e36b92 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:11.743433 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9a0ef655-1e76-42f1-b38a-c8a9b2e36b92 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:11.744163 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9a0ef655-1e76-42f1-b38a-c8a9b2e36b92 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:11.744608 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9a0ef655-1e76-42f1-b38a-c8a9b2e36b92 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:11.745056 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9a0ef655-1e76-42f1-b38a-c8a9b2e36b92 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:11.993736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-48cb9e61-2826-49ed-94d2-1e99defe51c6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:11.995999 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-48cb9e61-2826-49ed-94d2-1e99defe51c6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:12.002903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48cb9e61-2826-49ed-94d2-1e99defe51c6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:12.003524 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48cb9e61-2826-49ed-94d2-1e99defe51c6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:12.003989 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48cb9e61-2826-49ed-94d2-1e99defe51c6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:12.004693 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48cb9e61-2826-49ed-94d2-1e99defe51c6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:12.005138 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48cb9e61-2826-49ed-94d2-1e99defe51c6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:12.005554 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-48cb9e61-2826-49ed-94d2-1e99defe51c6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:12.082814 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-48cb9e61-2826-49ed-94d2-1e99defe51c6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "POST /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/action" status: 202 len: 0 microversion: 2.1 time: 0.092687 Aug 31 11:09:12.083731 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 228/506] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:09:11 2022] POST /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:09:12.092081 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-eae92ea0-110f-40a3-94d2-1e4450d6adf6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:12.092784 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-eae92ea0-110f-40a3-94d2-1e4450d6adf6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:12.094340 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9a0ef655-1e76-42f1-b38a-c8a9b2e36b92 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:12.100233 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eae92ea0-110f-40a3-94d2-1e4450d6adf6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:12.100586 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eae92ea0-110f-40a3-94d2-1e4450d6adf6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:12.101014 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eae92ea0-110f-40a3-94d2-1e4450d6adf6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:12.101733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eae92ea0-110f-40a3-94d2-1e4450d6adf6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:12.102151 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eae92ea0-110f-40a3-94d2-1e4450d6adf6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:12.102568 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eae92ea0-110f-40a3-94d2-1e4450d6adf6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:12.104147 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9a0ef655-1e76-42f1-b38a-c8a9b2e36b92 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.373700 Aug 31 11:09:12.105013 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 279/507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:11 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:12.252385 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-eae92ea0-110f-40a3-94d2-1e4450d6adf6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:12.261308 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-eae92ea0-110f-40a3-94d2-1e4450d6adf6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1750 microversion: 2.1 time: 0.173255 Aug 31 11:09:12.261881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 229/508] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:12 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:12.325730 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-84462e27-3ab3-4df8-8bfd-0092290d27b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:12.326390 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-84462e27-3ab3-4df8-8bfd-0092290d27b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:12.333864 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-84462e27-3ab3-4df8-8bfd-0092290d27b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:12.334349 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-84462e27-3ab3-4df8-8bfd-0092290d27b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:12.334810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-84462e27-3ab3-4df8-8bfd-0092290d27b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:12.335519 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-84462e27-3ab3-4df8-8bfd-0092290d27b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:12.335969 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-84462e27-3ab3-4df8-8bfd-0092290d27b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:12.336513 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-84462e27-3ab3-4df8-8bfd-0092290d27b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:12.477732 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-84462e27-3ab3-4df8-8bfd-0092290d27b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:12.485494 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-84462e27-3ab3-4df8-8bfd-0092290d27b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1681 microversion: 2.1 time: 0.163610 Aug 31 11:09:12.486056 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 280/509] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:12 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:13.125316 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-66c61696-d500-4428-a136-422b929ca4cb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:13.126168 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-66c61696-d500-4428-a136-422b929ca4cb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:13.134082 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-66c61696-d500-4428-a136-422b929ca4cb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:13.134578 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-66c61696-d500-4428-a136-422b929ca4cb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:13.135017 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-66c61696-d500-4428-a136-422b929ca4cb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:13.135729 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-66c61696-d500-4428-a136-422b929ca4cb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:13.136226 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-66c61696-d500-4428-a136-422b929ca4cb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:13.136659 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-66c61696-d500-4428-a136-422b929ca4cb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:13.284902 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b20e5458-710f-446b-8a89-615ad9560817 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:13.285468 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b20e5458-710f-446b-8a89-615ad9560817 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:13.292258 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b20e5458-710f-446b-8a89-615ad9560817 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:13.292743 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b20e5458-710f-446b-8a89-615ad9560817 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:13.293178 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b20e5458-710f-446b-8a89-615ad9560817 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:13.293896 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b20e5458-710f-446b-8a89-615ad9560817 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:13.294341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b20e5458-710f-446b-8a89-615ad9560817 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:13.294762 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b20e5458-710f-446b-8a89-615ad9560817 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:13.452160 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b20e5458-710f-446b-8a89-615ad9560817 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:13.471379 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b20e5458-710f-446b-8a89-615ad9560817 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1750 microversion: 2.1 time: 0.190873 Aug 31 11:09:13.472717 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 281/510] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:13 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1750 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:13.491870 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-66c61696-d500-4428-a136-422b929ca4cb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:13.499975 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-66c61696-d500-4428-a136-422b929ca4cb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.379059 Aug 31 11:09:13.500566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 230/511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:13 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:13.507022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-61e0588a-fee0-4360-9f1b-67a88a438639 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:13.507624 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-61e0588a-fee0-4360-9f1b-67a88a438639 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:13.513719 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-61e0588a-fee0-4360-9f1b-67a88a438639 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:13.514197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-61e0588a-fee0-4360-9f1b-67a88a438639 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:13.514626 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-61e0588a-fee0-4360-9f1b-67a88a438639 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:13.515332 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-61e0588a-fee0-4360-9f1b-67a88a438639 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:13.515758 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-61e0588a-fee0-4360-9f1b-67a88a438639 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:13.516447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-61e0588a-fee0-4360-9f1b-67a88a438639 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:13.661302 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-61e0588a-fee0-4360-9f1b-67a88a438639 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:13.669296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-61e0588a-fee0-4360-9f1b-67a88a438639 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1681 microversion: 2.1 time: 0.166247 Aug 31 11:09:13.669893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 282/512] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:13 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:14.275652 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-29714a11-28e1-4890-a7ab-b319a45e0561 req-839c751e-2d2b-406a-a6ec-bebd2df418b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9af9ee9-af17-4f68-bb4a-dcebd9827b12", "name": "network-vif-deleted", "tag": "2270adbc-f6f1-4f49-bcf6-15ac3f4a262a"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:14.288434 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-29714a11-28e1-4890-a7ab-b319a45e0561 req-839c751e-2d2b-406a-a6ec-bebd2df418b3 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:14.288923 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-29714a11-28e1-4890-a7ab-b319a45e0561 req-839c751e-2d2b-406a-a6ec-bebd2df418b3 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:14.289478 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-29714a11-28e1-4890-a7ab-b319a45e0561 req-839c751e-2d2b-406a-a6ec-bebd2df418b3 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:14.303201 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-29714a11-28e1-4890-a7ab-b319a45e0561 req-839c751e-2d2b-406a-a6ec-bebd2df418b3 service nova] Creating event network-vif-deleted:2270adbc-f6f1-4f49-bcf6-15ac3f4a262a for instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 on hv-cinder-85535 Aug 31 11:09:14.309125 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-29714a11-28e1-4890-a7ab-b319a45e0561 req-839c751e-2d2b-406a-a6ec-bebd2df418b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037986 Aug 31 11:09:14.309967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 231/513] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:14.494300 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-814c252f-1531-4d54-8458-a16bd7d35db7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:14.494908 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-814c252f-1531-4d54-8458-a16bd7d35db7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:14.501841 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-814c252f-1531-4d54-8458-a16bd7d35db7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:14.502324 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-814c252f-1531-4d54-8458-a16bd7d35db7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:14.502780 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-814c252f-1531-4d54-8458-a16bd7d35db7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:14.503690 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-814c252f-1531-4d54-8458-a16bd7d35db7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:14.504171 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-814c252f-1531-4d54-8458-a16bd7d35db7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:14.504592 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-814c252f-1531-4d54-8458-a16bd7d35db7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:14.522671 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e1ce4bab-fab9-48cf-94bd-488cde13a2f3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:14.524072 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e1ce4bab-fab9-48cf-94bd-488cde13a2f3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:14.530643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e1ce4bab-fab9-48cf-94bd-488cde13a2f3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:14.531362 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e1ce4bab-fab9-48cf-94bd-488cde13a2f3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:14.531861 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e1ce4bab-fab9-48cf-94bd-488cde13a2f3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:14.532666 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e1ce4bab-fab9-48cf-94bd-488cde13a2f3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:14.533273 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e1ce4bab-fab9-48cf-94bd-488cde13a2f3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:14.533964 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e1ce4bab-fab9-48cf-94bd-488cde13a2f3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:14.555631 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:14.676654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-814c252f-1531-4d54-8458-a16bd7d35db7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:14.690868 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-814c252f-1531-4d54-8458-a16bd7d35db7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.199285 Aug 31 11:09:14.691793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 283/514] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:14 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:14.696831 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:14.697680 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:14.704047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:14.704536 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:14.704975 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:14.705784 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:14.707883 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:14.708551 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:14.714068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e1ce4bab-fab9-48cf-94bd-488cde13a2f3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:14.724030 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e1ce4bab-fab9-48cf-94bd-488cde13a2f3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.205889 Aug 31 11:09:14.725235 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 232/515] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:14 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:14.745876 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:14.746366 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:14.746795 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:14.747243 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lazy-loading 'fault' on Instance uuid a9af9ee9-af17-4f68-bb4a-dcebd9827b12 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:09:14.802617 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:14.810866 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b518f915-a6a3-4590-9039-2b00d1414c97 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 200 len: 1331 microversion: 2.1 time: 0.117707 Aug 31 11:09:14.811437 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 284/516] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:14 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:15.713228 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-2ebb1df8-6825-4fc9-89b2-162d8a5ff004 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:15.714600 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-2ebb1df8-6825-4fc9-89b2-162d8a5ff004 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:15.723575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2ebb1df8-6825-4fc9-89b2-162d8a5ff004 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:15.724002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2ebb1df8-6825-4fc9-89b2-162d8a5ff004 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:15.724461 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2ebb1df8-6825-4fc9-89b2-162d8a5ff004 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:15.725153 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2ebb1df8-6825-4fc9-89b2-162d8a5ff004 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:15.725597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2ebb1df8-6825-4fc9-89b2-162d8a5ff004 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:15.726014 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2ebb1df8-6825-4fc9-89b2-162d8a5ff004 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:15.748382 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c75a4233-31f0-4915-ac0b-a635a323503c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:15.749002 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c75a4233-31f0-4915-ac0b-a635a323503c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:15.755463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c75a4233-31f0-4915-ac0b-a635a323503c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:15.755951 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c75a4233-31f0-4915-ac0b-a635a323503c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:15.756421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c75a4233-31f0-4915-ac0b-a635a323503c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:15.757127 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c75a4233-31f0-4915-ac0b-a635a323503c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:15.757705 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c75a4233-31f0-4915-ac0b-a635a323503c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:15.758007 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c75a4233-31f0-4915-ac0b-a635a323503c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:15.878394 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-2ebb1df8-6825-4fc9-89b2-162d8a5ff004 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:15.886800 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-2ebb1df8-6825-4fc9-89b2-162d8a5ff004 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.177593 Aug 31 11:09:15.887377 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 233/517] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:15 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:15.889771 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c75a4233-31f0-4915-ac0b-a635a323503c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:15.891876 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9b91a4ba-ad9f-491d-8f3a-5f19cafae889 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:15.892506 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-9b91a4ba-ad9f-491d-8f3a-5f19cafae889 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:15.899206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c75a4233-31f0-4915-ac0b-a635a323503c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.154804 Aug 31 11:09:15.899788 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9b91a4ba-ad9f-491d-8f3a-5f19cafae889 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:15.900106 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 285/518] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:15 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:15.900308 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9b91a4ba-ad9f-491d-8f3a-5f19cafae889 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:15.900741 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9b91a4ba-ad9f-491d-8f3a-5f19cafae889 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:15.901441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9b91a4ba-ad9f-491d-8f3a-5f19cafae889 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:15.901888 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9b91a4ba-ad9f-491d-8f3a-5f19cafae889 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:15.902309 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9b91a4ba-ad9f-491d-8f3a-5f19cafae889 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:15.916459 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-9b91a4ba-ad9f-491d-8f3a-5f19cafae889 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9b91a4ba-ad9f-491d-8f3a-5f19cafae889 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 HTTP/1.1 Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:09:15.918133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:09:15.919689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:09:15.919689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:09:15.919689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:09:15.919689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:09:15.919689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:09:15.919689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:09:15.919689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:09:15.919689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:09:15.919689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:09:15.919689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:09:15.919689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:09:15.919689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': 'a9af9ee9-af17-4f68-bb4a-dcebd9827b12'} Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:09:15.920881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:09:15.922374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:15.923797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9b91a4ba-ad9f-491d-8f3a-5f19cafae889 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 404 to user: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:09:15.923797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-9b91a4ba-ad9f-491d-8f3a-5f19cafae889 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 404 len: 111 microversion: 2.1 time: 0.031231 Aug 31 11:09:15.923797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 234/519] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:15 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:09:15.928528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0e0fd992-8b4b-4dc5-bbc2-3c79db2f4bc1 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '.version_select at 0x7f732d31d0d0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:15.952283 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0e0fd992-8b4b-4dc5-bbc2-3c79db2f4bc1 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-636628674" status: 202 len: 0 microversion: 2.1 time: 0.027643 Aug 31 11:09:15.952858 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 286/520] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Aug 31 11:09:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-636628674 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:09:16.608524 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-58a487db-bf92-42d7-a8f8-e1117f310967 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: .version_select at 0x7f732e227940>, body: {"keypair": {"name": "tempest-keypair-2060852104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMzwB8gFmFkMij0qujoY9asScdXqUa0sfKp3pZFGuTXf07V8fB/KlCHCwooGnEqA/7mB0yywqSzQY1S6MoOy8gmG6TFudI+NHuRzPdACa3bescVrxoCJmqV+5RLUA7wqw=="}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:16.624262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-58a487db-bf92-42d7-a8f8-e1117f310967 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:09:16.628596 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-58a487db-bf92-42d7-a8f8-e1117f310967 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for user d0e5dae087184c56b1cb72fb7705d4d5 and project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:09:16.651323 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-58a487db-bf92-42d7-a8f8-e1117f310967 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046504 Aug 31 11:09:16.651995 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 235/521] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 11:09:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:16.910685 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-70a1bd71-8cd0-4c97-ac72-632e6e5865fc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:16.911455 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-70a1bd71-8cd0-4c97-ac72-632e6e5865fc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:16.919578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-70a1bd71-8cd0-4c97-ac72-632e6e5865fc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:16.920096 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-70a1bd71-8cd0-4c97-ac72-632e6e5865fc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:16.920589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-70a1bd71-8cd0-4c97-ac72-632e6e5865fc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:16.921783 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-70a1bd71-8cd0-4c97-ac72-632e6e5865fc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:16.922220 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-70a1bd71-8cd0-4c97-ac72-632e6e5865fc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:16.922872 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-70a1bd71-8cd0-4c97-ac72-632e6e5865fc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:16.923707 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5eeb5e62-0859-416f-81c8-efd653b79b56 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:16.925719 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-5eeb5e62-0859-416f-81c8-efd653b79b56 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:16.927303 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:16.939172 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5eeb5e62-0859-416f-81c8-efd653b79b56 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:16.941899 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5eeb5e62-0859-416f-81c8-efd653b79b56 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:16.942578 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5eeb5e62-0859-416f-81c8-efd653b79b56 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:16.943499 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5eeb5e62-0859-416f-81c8-efd653b79b56 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:16.945599 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5eeb5e62-0859-416f-81c8-efd653b79b56 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:16.946295 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5eeb5e62-0859-416f-81c8-efd653b79b56 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:17.085386 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-70a1bd71-8cd0-4c97-ac72-632e6e5865fc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:17.094143 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-70a1bd71-8cd0-4c97-ac72-632e6e5865fc tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.188556 Aug 31 11:09:17.095098 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 287/522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:16 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:17.151581 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5eeb5e62-0859-416f-81c8-efd653b79b56 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:17.160357 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-5eeb5e62-0859-416f-81c8-efd653b79b56 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.242882 Aug 31 11:09:17.160960 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 236/523] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:16 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:18.066421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-267827842", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6f1d69a-015b-48c6-bbc4-eabba1f958e8"}], "security_groups": [{"name": "tempest-securitygroup--1752517406"}], "key_name": "tempest-keypair-2060852104", "user_data": "}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:18.116178 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a1d1956e-fb0f-41b3-819a-2a4441cd6960 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:18.116781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a1d1956e-fb0f-41b3-819a-2a4441cd6960 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:18.124191 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a1d1956e-fb0f-41b3-819a-2a4441cd6960 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:18.124800 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a1d1956e-fb0f-41b3-819a-2a4441cd6960 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:18.125323 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a1d1956e-fb0f-41b3-819a-2a4441cd6960 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:18.126292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a1d1956e-fb0f-41b3-819a-2a4441cd6960 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:18.126745 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a1d1956e-fb0f-41b3-819a-2a4441cd6960 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:18.127168 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a1d1956e-fb0f-41b3-819a-2a4441cd6960 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:18.183208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] validate_networks() for [('b6f1d69a-015b-48c6-bbc4-eabba1f958e8', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:09:18.284608 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a1d1956e-fb0f-41b3-819a-2a4441cd6960 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:18.293262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a1d1956e-fb0f-41b3-819a-2a4441cd6960 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.180855 Aug 31 11:09:18.293943 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 237/524] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:18 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:18.305043 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-763762ab-1d15-46a8-970a-1eac26013a0f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:18.306741 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-763762ab-1d15-46a8-970a-1eac26013a0f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:18.318099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-763762ab-1d15-46a8-970a-1eac26013a0f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:18.318800 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-763762ab-1d15-46a8-970a-1eac26013a0f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:18.319268 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-763762ab-1d15-46a8-970a-1eac26013a0f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:18.320319 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-763762ab-1d15-46a8-970a-1eac26013a0f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:18.320958 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-763762ab-1d15-46a8-970a-1eac26013a0f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:18.321694 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-763762ab-1d15-46a8-970a-1eac26013a0f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:18.473816 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-763762ab-1d15-46a8-970a-1eac26013a0f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:18.482317 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-763762ab-1d15-46a8-970a-1eac26013a0f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.185922 Aug 31 11:09:18.482787 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 238/525] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:18 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:18.579647 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:09:18.580102 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:09:18.580610 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:09:18.581182 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:09:18.581720 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:09:18.590619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:18.591101 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:18.591532 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:18.592292 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:18.592746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:18.593170 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:18.609769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:09:18.614376 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for user d0e5dae087184c56b1cb72fb7705d4d5 and project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:09:18.625242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:09:18.627558 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:09:18.674878 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-173a145c-ab41-4074-acdb-584f945a0737 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.612230 Aug 31 11:09:18.675792 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 288/526] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:09:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 11:09:18.687986 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-98586de7-1af5-4e25-98cb-2d0a76befb60 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:18.688629 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-98586de7-1af5-4e25-98cb-2d0a76befb60 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:18.748200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-98586de7-1af5-4e25-98cb-2d0a76befb60 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:18.755753 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-98586de7-1af5-4e25-98cb-2d0a76befb60 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1241 microversion: 2.1 time: 0.071922 Aug 31 11:09:18.756354 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 239/527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:18 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:19.315941 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fa7228c0-f839-4f30-ab75-81d00dd82459 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:19.316845 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fa7228c0-f839-4f30-ab75-81d00dd82459 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:19.323885 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa7228c0-f839-4f30-ab75-81d00dd82459 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:19.324544 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa7228c0-f839-4f30-ab75-81d00dd82459 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:19.325129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa7228c0-f839-4f30-ab75-81d00dd82459 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:19.326062 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa7228c0-f839-4f30-ab75-81d00dd82459 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:19.326744 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa7228c0-f839-4f30-ab75-81d00dd82459 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:19.327369 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa7228c0-f839-4f30-ab75-81d00dd82459 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:19.469820 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ba7d1b6c-54ee-4a1b-ab00-f75da36afec3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48486b7c-e31a-4f04-821c-9e42e2234577"}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:19.473182 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ba7d1b6c-54ee-4a1b-ab00-f75da36afec3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:19.486964 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ba7d1b6c-54ee-4a1b-ab00-f75da36afec3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:19.487463 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ba7d1b6c-54ee-4a1b-ab00-f75da36afec3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:19.487903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ba7d1b6c-54ee-4a1b-ab00-f75da36afec3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:19.488980 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ba7d1b6c-54ee-4a1b-ab00-f75da36afec3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:19.490842 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ba7d1b6c-54ee-4a1b-ab00-f75da36afec3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:19.492343 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ba7d1b6c-54ee-4a1b-ab00-f75da36afec3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:19.501534 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fa7228c0-f839-4f30-ab75-81d00dd82459 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:19.510718 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fa7228c0-f839-4f30-ab75-81d00dd82459 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.199458 Aug 31 11:09:19.528196 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 289/528] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:19 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:19.536307 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-83c71a29-15ec-4332-91a2-ec6a3bf8e8d7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:19.537794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-83c71a29-15ec-4332-91a2-ec6a3bf8e8d7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:19.545095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-83c71a29-15ec-4332-91a2-ec6a3bf8e8d7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:19.545631 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-83c71a29-15ec-4332-91a2-ec6a3bf8e8d7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:19.546106 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-83c71a29-15ec-4332-91a2-ec6a3bf8e8d7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:19.546805 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-83c71a29-15ec-4332-91a2-ec6a3bf8e8d7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:19.547508 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-83c71a29-15ec-4332-91a2-ec6a3bf8e8d7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:19.548207 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-83c71a29-15ec-4332-91a2-ec6a3bf8e8d7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:19.728606 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-83c71a29-15ec-4332-91a2-ec6a3bf8e8d7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:19.739847 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-83c71a29-15ec-4332-91a2-ec6a3bf8e8d7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.210026 Aug 31 11:09:19.740593 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 290/529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:19 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:19.781861 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f78e045b-b9d7-4e2e-bbbe-f15936c09025 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:19.783343 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f78e045b-b9d7-4e2e-bbbe-f15936c09025 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:19.795327 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f78e045b-b9d7-4e2e-bbbe-f15936c09025 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:19.795815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f78e045b-b9d7-4e2e-bbbe-f15936c09025 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:19.796283 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f78e045b-b9d7-4e2e-bbbe-f15936c09025 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:19.796992 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f78e045b-b9d7-4e2e-bbbe-f15936c09025 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:19.797435 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f78e045b-b9d7-4e2e-bbbe-f15936c09025 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:19.797851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f78e045b-b9d7-4e2e-bbbe-f15936c09025 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:19.816797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ba7d1b6c-54ee-4a1b-ab00-f75da36afec3 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "POST /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349587 Aug 31 11:09:19.817727 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 240/530] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:09:19 2022] POST /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:19.863615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f78e045b-b9d7-4e2e-bbbe-f15936c09025 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:19.871360 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f78e045b-b9d7-4e2e-bbbe-f15936c09025 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1293 microversion: 2.1 time: 0.098260 Aug 31 11:09:19.871916 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 291/531] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:19 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:20.533537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-751755f3-c6d5-4bb6-bcd8-dddf46d1930f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:20.534899 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-751755f3-c6d5-4bb6-bcd8-dddf46d1930f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:20.541829 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-751755f3-c6d5-4bb6-bcd8-dddf46d1930f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:20.542351 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-751755f3-c6d5-4bb6-bcd8-dddf46d1930f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:20.542821 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-751755f3-c6d5-4bb6-bcd8-dddf46d1930f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:20.543678 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-751755f3-c6d5-4bb6-bcd8-dddf46d1930f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:20.544148 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-751755f3-c6d5-4bb6-bcd8-dddf46d1930f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:20.544569 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-751755f3-c6d5-4bb6-bcd8-dddf46d1930f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:20.762793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-bfef968a-3077-4578-8236-c3df8a0743e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:20.763521 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-bfef968a-3077-4578-8236-c3df8a0743e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:20.770690 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bfef968a-3077-4578-8236-c3df8a0743e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:20.771285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bfef968a-3077-4578-8236-c3df8a0743e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:20.771810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bfef968a-3077-4578-8236-c3df8a0743e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:20.772654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bfef968a-3077-4578-8236-c3df8a0743e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:20.773237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bfef968a-3077-4578-8236-c3df8a0743e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:20.773725 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bfef968a-3077-4578-8236-c3df8a0743e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:20.813436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-751755f3-c6d5-4bb6-bcd8-dddf46d1930f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:20.824495 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-751755f3-c6d5-4bb6-bcd8-dddf46d1930f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.295349 Aug 31 11:09:20.825438 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 241/532] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:20 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:20.898056 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8ddaf71e-2ec7-4359-ab60-c869932f0e4a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:20.898811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8ddaf71e-2ec7-4359-ab60-c869932f0e4a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:20.907116 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ddaf71e-2ec7-4359-ab60-c869932f0e4a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:20.907496 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-bfef968a-3077-4578-8236-c3df8a0743e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:20.907630 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ddaf71e-2ec7-4359-ab60-c869932f0e4a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:20.908049 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ddaf71e-2ec7-4359-ab60-c869932f0e4a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:20.909436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ddaf71e-2ec7-4359-ab60-c869932f0e4a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:20.910183 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ddaf71e-2ec7-4359-ab60-c869932f0e4a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:20.910609 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ddaf71e-2ec7-4359-ab60-c869932f0e4a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:20.919696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-bfef968a-3077-4578-8236-c3df8a0743e4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.160626 Aug 31 11:09:20.931984 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 292/533] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:20 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:20.991163 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8ddaf71e-2ec7-4359-ab60-c869932f0e4a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:20.998851 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8ddaf71e-2ec7-4359-ab60-c869932f0e4a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1299 microversion: 2.1 time: 0.109763 Aug 31 11:09:20.999412 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 242/534] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:20 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:21.848219 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1e287a78-e62c-4bfd-81cf-8c72974d5382 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:21.849773 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1e287a78-e62c-4bfd-81cf-8c72974d5382 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:21.856368 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e287a78-e62c-4bfd-81cf-8c72974d5382 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:21.856858 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e287a78-e62c-4bfd-81cf-8c72974d5382 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:21.857295 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e287a78-e62c-4bfd-81cf-8c72974d5382 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:21.858138 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e287a78-e62c-4bfd-81cf-8c72974d5382 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:21.859320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e287a78-e62c-4bfd-81cf-8c72974d5382 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:21.860217 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e287a78-e62c-4bfd-81cf-8c72974d5382 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:21.865341 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-2d9faa7f-d693-451c-aa35-1b5d3a5ce1ba req-0784debb-bdcb-45fd-a72c-95e09d68be95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f70e795-e50c-414e-b302-2b818ce84337", "tag": "1facded0-b145-4c4f-a2ec-cbef8e6d0174"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:21.876456 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-2d9faa7f-d693-451c-aa35-1b5d3a5ce1ba req-0784debb-bdcb-45fd-a72c-95e09d68be95 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:21.876935 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-2d9faa7f-d693-451c-aa35-1b5d3a5ce1ba req-0784debb-bdcb-45fd-a72c-95e09d68be95 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:21.877397 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-2d9faa7f-d693-451c-aa35-1b5d3a5ce1ba req-0784debb-bdcb-45fd-a72c-95e09d68be95 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:21.890598 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-2d9faa7f-d693-451c-aa35-1b5d3a5ce1ba req-0784debb-bdcb-45fd-a72c-95e09d68be95 service nova] Creating event network-changed:1facded0-b145-4c4f-a2ec-cbef8e6d0174 for instance 2f70e795-e50c-414e-b302-2b818ce84337 on hv-cinder-85535 Aug 31 11:09:21.896329 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-2d9faa7f-d693-451c-aa35-1b5d3a5ce1ba req-0784debb-bdcb-45fd-a72c-95e09d68be95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034763 Aug 31 11:09:21.897975 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 243/535] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:21.943550 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8f6e6b6c-13ae-4b1e-9d5a-f5a82edb50b9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:21.944282 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8f6e6b6c-13ae-4b1e-9d5a-f5a82edb50b9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:21.950657 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8f6e6b6c-13ae-4b1e-9d5a-f5a82edb50b9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:21.951024 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8f6e6b6c-13ae-4b1e-9d5a-f5a82edb50b9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:21.951460 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8f6e6b6c-13ae-4b1e-9d5a-f5a82edb50b9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:21.952389 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8f6e6b6c-13ae-4b1e-9d5a-f5a82edb50b9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:21.953002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8f6e6b6c-13ae-4b1e-9d5a-f5a82edb50b9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:21.953586 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8f6e6b6c-13ae-4b1e-9d5a-f5a82edb50b9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:22.052596 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-1e287a78-e62c-4bfd-81cf-8c72974d5382 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:22.060821 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1e287a78-e62c-4bfd-81cf-8c72974d5382 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.217892 Aug 31 11:09:22.061389 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 293/536] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:21 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:22.066000 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-dbd0c85c-7c8e-4929-8ddc-8caf0c1e32a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:22.066831 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-dbd0c85c-7c8e-4929-8ddc-8caf0c1e32a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:22.072661 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dbd0c85c-7c8e-4929-8ddc-8caf0c1e32a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:22.073433 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dbd0c85c-7c8e-4929-8ddc-8caf0c1e32a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:22.074101 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dbd0c85c-7c8e-4929-8ddc-8caf0c1e32a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:22.074798 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dbd0c85c-7c8e-4929-8ddc-8caf0c1e32a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:22.075247 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dbd0c85c-7c8e-4929-8ddc-8caf0c1e32a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:22.075667 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dbd0c85c-7c8e-4929-8ddc-8caf0c1e32a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:22.188926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8f6e6b6c-13ae-4b1e-9d5a-f5a82edb50b9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:22.197813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8f6e6b6c-13ae-4b1e-9d5a-f5a82edb50b9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.259243 Aug 31 11:09:22.199103 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 244/537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:21 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:22.211639 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-dbd0c85c-7c8e-4929-8ddc-8caf0c1e32a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:22.219388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-dbd0c85c-7c8e-4929-8ddc-8caf0c1e32a4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1367 microversion: 2.1 time: 0.156964 Aug 31 11:09:22.219971 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 294/538] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:22 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:23.082705 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e89992a9-0bc1-4314-8cc8-cfc61b5f1af8 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:23.083312 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e89992a9-0bc1-4314-8cc8-cfc61b5f1af8 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:23.089819 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e89992a9-0bc1-4314-8cc8-cfc61b5f1af8 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:23.090319 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e89992a9-0bc1-4314-8cc8-cfc61b5f1af8 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:23.090750 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e89992a9-0bc1-4314-8cc8-cfc61b5f1af8 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:23.091433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e89992a9-0bc1-4314-8cc8-cfc61b5f1af8 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:23.091995 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e89992a9-0bc1-4314-8cc8-cfc61b5f1af8 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:23.092410 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e89992a9-0bc1-4314-8cc8-cfc61b5f1af8 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:23.218754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-20410a04-ed36-4860-addd-4d69ea7a563a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:23.219560 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-20410a04-ed36-4860-addd-4d69ea7a563a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:23.223533 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:23.229044 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-20410a04-ed36-4860-addd-4d69ea7a563a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:23.229684 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-20410a04-ed36-4860-addd-4d69ea7a563a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:23.230121 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-20410a04-ed36-4860-addd-4d69ea7a563a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:23.230814 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-20410a04-ed36-4860-addd-4d69ea7a563a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:23.231262 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-20410a04-ed36-4860-addd-4d69ea7a563a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:23.231678 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-20410a04-ed36-4860-addd-4d69ea7a563a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:23.241251 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e89992a9-0bc1-4314-8cc8-cfc61b5f1af8 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:23.257595 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e89992a9-0bc1-4314-8cc8-cfc61b5f1af8 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.179595 Aug 31 11:09:23.258236 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 245/539] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:23 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:23.264403 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ffe2a2fb-5c3c-433c-9a60-bd8af27d5aa0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:23.265234 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ffe2a2fb-5c3c-433c-9a60-bd8af27d5aa0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:23.273888 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ffe2a2fb-5c3c-433c-9a60-bd8af27d5aa0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:23.274668 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ffe2a2fb-5c3c-433c-9a60-bd8af27d5aa0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:23.275150 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ffe2a2fb-5c3c-433c-9a60-bd8af27d5aa0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:23.275859 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ffe2a2fb-5c3c-433c-9a60-bd8af27d5aa0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:23.276503 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ffe2a2fb-5c3c-433c-9a60-bd8af27d5aa0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:23.276998 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ffe2a2fb-5c3c-433c-9a60-bd8af27d5aa0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:23.375752 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-20410a04-ed36-4860-addd-4d69ea7a563a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:23.384231 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-20410a04-ed36-4860-addd-4d69ea7a563a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.169213 Aug 31 11:09:23.385000 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 295/540] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:23 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:23.420621 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ffe2a2fb-5c3c-433c-9a60-bd8af27d5aa0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:23.429107 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ffe2a2fb-5c3c-433c-9a60-bd8af27d5aa0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1367 microversion: 2.1 time: 0.169363 Aug 31 11:09:23.429734 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 246/541] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:23 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:24.278725 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c552f20e-bbff-4938-9a63-27c5e9c34711 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:24.279266 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c552f20e-bbff-4938-9a63-27c5e9c34711 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:24.286502 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c552f20e-bbff-4938-9a63-27c5e9c34711 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:24.286987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c552f20e-bbff-4938-9a63-27c5e9c34711 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:24.287430 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c552f20e-bbff-4938-9a63-27c5e9c34711 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:24.288147 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c552f20e-bbff-4938-9a63-27c5e9c34711 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:24.288599 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c552f20e-bbff-4938-9a63-27c5e9c34711 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:24.289019 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c552f20e-bbff-4938-9a63-27c5e9c34711 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:24.406240 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d021e31e-e349-4606-84df-ce8da56bc86c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:24.407013 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d021e31e-e349-4606-84df-ce8da56bc86c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:24.413905 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d021e31e-e349-4606-84df-ce8da56bc86c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:24.414386 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d021e31e-e349-4606-84df-ce8da56bc86c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:24.414820 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d021e31e-e349-4606-84df-ce8da56bc86c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:24.415799 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d021e31e-e349-4606-84df-ce8da56bc86c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:24.416302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d021e31e-e349-4606-84df-ce8da56bc86c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:24.416722 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d021e31e-e349-4606-84df-ce8da56bc86c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:24.438564 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c552f20e-bbff-4938-9a63-27c5e9c34711 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:24.448199 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c552f20e-bbff-4938-9a63-27c5e9c34711 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.173231 Aug 31 11:09:24.448786 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 296/542] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:24 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:24.453267 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7898f0f8-d360-471e-9d0c-1d2a09ee98a7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:24.453881 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7898f0f8-d360-471e-9d0c-1d2a09ee98a7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:24.462071 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7898f0f8-d360-471e-9d0c-1d2a09ee98a7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:24.462071 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7898f0f8-d360-471e-9d0c-1d2a09ee98a7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:24.462071 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7898f0f8-d360-471e-9d0c-1d2a09ee98a7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:24.462071 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7898f0f8-d360-471e-9d0c-1d2a09ee98a7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:24.462524 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7898f0f8-d360-471e-9d0c-1d2a09ee98a7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:24.462817 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7898f0f8-d360-471e-9d0c-1d2a09ee98a7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:24.553717 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d021e31e-e349-4606-84df-ce8da56bc86c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:24.562535 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d021e31e-e349-4606-84df-ce8da56bc86c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.160082 Aug 31 11:09:24.563119 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 247/543] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:24 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:24.601471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7898f0f8-d360-471e-9d0c-1d2a09ee98a7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:24.609139 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7898f0f8-d360-471e-9d0c-1d2a09ee98a7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1367 microversion: 2.1 time: 0.159407 Aug 31 11:09:24.609701 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 297/544] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:24 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:25.469353 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4f9f37f3-ab88-4662-b7b1-31b901004e06 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:25.469876 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-4f9f37f3-ab88-4662-b7b1-31b901004e06 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:25.476972 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4f9f37f3-ab88-4662-b7b1-31b901004e06 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:25.477442 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4f9f37f3-ab88-4662-b7b1-31b901004e06 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:25.477874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4f9f37f3-ab88-4662-b7b1-31b901004e06 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:25.478558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4f9f37f3-ab88-4662-b7b1-31b901004e06 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:25.478999 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4f9f37f3-ab88-4662-b7b1-31b901004e06 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:25.479415 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4f9f37f3-ab88-4662-b7b1-31b901004e06 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:25.584688 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ea004e78-7fd9-4d87-93d8-1f65e34c0414 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:25.585401 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ea004e78-7fd9-4d87-93d8-1f65e34c0414 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:25.591883 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ea004e78-7fd9-4d87-93d8-1f65e34c0414 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:25.592506 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ea004e78-7fd9-4d87-93d8-1f65e34c0414 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:25.593015 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ea004e78-7fd9-4d87-93d8-1f65e34c0414 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:25.593721 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ea004e78-7fd9-4d87-93d8-1f65e34c0414 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:25.594179 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ea004e78-7fd9-4d87-93d8-1f65e34c0414 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:25.594661 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ea004e78-7fd9-4d87-93d8-1f65e34c0414 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:25.625389 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4f9f37f3-ab88-4662-b7b1-31b901004e06 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:25.634674 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4f9f37f3-ab88-4662-b7b1-31b901004e06 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.169152 Aug 31 11:09:25.635257 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 248/545] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:25 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:25.639831 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-2f3d00a2-af44-474e-ac72-f91d20134258 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:25.640617 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-2f3d00a2-af44-474e-ac72-f91d20134258 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:25.651392 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2f3d00a2-af44-474e-ac72-f91d20134258 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:25.652661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2f3d00a2-af44-474e-ac72-f91d20134258 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:25.652661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2f3d00a2-af44-474e-ac72-f91d20134258 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:25.653136 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2f3d00a2-af44-474e-ac72-f91d20134258 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:25.653591 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2f3d00a2-af44-474e-ac72-f91d20134258 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:25.654021 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2f3d00a2-af44-474e-ac72-f91d20134258 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:25.753615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ea004e78-7fd9-4d87-93d8-1f65e34c0414 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:25.762292 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ea004e78-7fd9-4d87-93d8-1f65e34c0414 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.182139 Aug 31 11:09:25.763451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 298/546] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:25 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:25.813189 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-2f3d00a2-af44-474e-ac72-f91d20134258 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:25.822347 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-2f3d00a2-af44-474e-ac72-f91d20134258 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1367 microversion: 2.1 time: 0.186049 Aug 31 11:09:25.822947 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 249/547] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:25 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:26.660228 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-75a8e143-1655-4678-9af7-14d7c019cf41 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:26.661197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-75a8e143-1655-4678-9af7-14d7c019cf41 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:26.669350 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-75a8e143-1655-4678-9af7-14d7c019cf41 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:26.669835 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-75a8e143-1655-4678-9af7-14d7c019cf41 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:26.670260 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-75a8e143-1655-4678-9af7-14d7c019cf41 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:26.670951 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-75a8e143-1655-4678-9af7-14d7c019cf41 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:26.671393 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-75a8e143-1655-4678-9af7-14d7c019cf41 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:26.671806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-75a8e143-1655-4678-9af7-14d7c019cf41 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:26.786163 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c5842a3b-6d74-409a-b9a9-36d93fc85d9b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:26.787370 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c5842a3b-6d74-409a-b9a9-36d93fc85d9b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:26.795565 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c5842a3b-6d74-409a-b9a9-36d93fc85d9b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:26.796091 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c5842a3b-6d74-409a-b9a9-36d93fc85d9b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:26.796731 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c5842a3b-6d74-409a-b9a9-36d93fc85d9b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:26.797618 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c5842a3b-6d74-409a-b9a9-36d93fc85d9b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:26.798258 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c5842a3b-6d74-409a-b9a9-36d93fc85d9b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:26.799911 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c5842a3b-6d74-409a-b9a9-36d93fc85d9b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:26.831825 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-75a8e143-1655-4678-9af7-14d7c019cf41 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:26.841086 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-75a8e143-1655-4678-9af7-14d7c019cf41 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.186236 Aug 31 11:09:26.842072 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 299/548] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:26 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:26.848088 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e09a63e2-ab61-43f5-ab48-c64a47efa45b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:26.851579 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e09a63e2-ab61-43f5-ab48-c64a47efa45b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:26.861746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e09a63e2-ab61-43f5-ab48-c64a47efa45b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:26.863256 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e09a63e2-ab61-43f5-ab48-c64a47efa45b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:26.863918 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e09a63e2-ab61-43f5-ab48-c64a47efa45b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:26.864846 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e09a63e2-ab61-43f5-ab48-c64a47efa45b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:26.865373 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e09a63e2-ab61-43f5-ab48-c64a47efa45b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:26.865887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e09a63e2-ab61-43f5-ab48-c64a47efa45b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:26.943708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c5842a3b-6d74-409a-b9a9-36d93fc85d9b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:26.947335 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:26.953820 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c5842a3b-6d74-409a-b9a9-36d93fc85d9b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.172108 Aug 31 11:09:26.954411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 250/549] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:26 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:27.007523 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e09a63e2-ab61-43f5-ab48-c64a47efa45b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:27.015129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e09a63e2-ab61-43f5-ab48-c64a47efa45b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1367 microversion: 2.1 time: 0.171861 Aug 31 11:09:27.015716 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 300/550] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:26 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:27.405774 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5d5a52df-1e7b-4a0e-a02c-2a3f5d824650 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:27.408092 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-5d5a52df-1e7b-4a0e-a02c-2a3f5d824650 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:27.416197 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5d5a52df-1e7b-4a0e-a02c-2a3f5d824650 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.416686 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5d5a52df-1e7b-4a0e-a02c-2a3f5d824650 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.417157 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5d5a52df-1e7b-4a0e-a02c-2a3f5d824650 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.417811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5d5a52df-1e7b-4a0e-a02c-2a3f5d824650 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.418260 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5d5a52df-1e7b-4a0e-a02c-2a3f5d824650 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.418679 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5d5a52df-1e7b-4a0e-a02c-2a3f5d824650 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.442689 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-5d5a52df-1e7b-4a0e-a02c-2a3f5d824650 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lazy-loading 'flavor' on Instance uuid f01be6c4-bf01-4970-87ca-7c8e3cf14524 {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:09:27.568644 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-5d5a52df-1e7b-4a0e-a02c-2a3f5d824650 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "POST /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/action" status: 200 len: 32 microversion: 2.1 time: 0.166675 Aug 31 11:09:27.569155 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 251/551] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:09:27 2022] POST /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:09:27.578518 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6a65281d-1adb-444e-bffb-43367bcb6ef0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:27.579124 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6a65281d-1adb-444e-bffb-43367bcb6ef0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:27.585665 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a65281d-1adb-444e-bffb-43367bcb6ef0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.586133 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a65281d-1adb-444e-bffb-43367bcb6ef0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.586568 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a65281d-1adb-444e-bffb-43367bcb6ef0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.587258 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a65281d-1adb-444e-bffb-43367bcb6ef0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.587703 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a65281d-1adb-444e-bffb-43367bcb6ef0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.588142 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a65281d-1adb-444e-bffb-43367bcb6ef0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.719592 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6a65281d-1adb-444e-bffb-43367bcb6ef0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:27.727882 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6a65281d-1adb-444e-bffb-43367bcb6ef0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1734 microversion: 2.1 time: 0.153118 Aug 31 11:09:27.728501 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 301/552] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:27 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:27.864550 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7cb9a0c4-4a04-4bba-8e29-3ed5b229fd5a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:27.865258 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-7cb9a0c4-4a04-4bba-8e29-3ed5b229fd5a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:27.871410 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7cb9a0c4-4a04-4bba-8e29-3ed5b229fd5a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.871892 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7cb9a0c4-4a04-4bba-8e29-3ed5b229fd5a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.872360 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7cb9a0c4-4a04-4bba-8e29-3ed5b229fd5a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.873066 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7cb9a0c4-4a04-4bba-8e29-3ed5b229fd5a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.873514 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7cb9a0c4-4a04-4bba-8e29-3ed5b229fd5a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.873939 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7cb9a0c4-4a04-4bba-8e29-3ed5b229fd5a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.975785 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-122b4032-c0e1-4720-b111-dd3df7137e39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:27.976414 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-122b4032-c0e1-4720-b111-dd3df7137e39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:27.982904 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-122b4032-c0e1-4720-b111-dd3df7137e39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.983517 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-122b4032-c0e1-4720-b111-dd3df7137e39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.984180 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-122b4032-c0e1-4720-b111-dd3df7137e39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.984994 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-122b4032-c0e1-4720-b111-dd3df7137e39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.985545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-122b4032-c0e1-4720-b111-dd3df7137e39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.986048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-122b4032-c0e1-4720-b111-dd3df7137e39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:28.109617 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7cb9a0c4-4a04-4bba-8e29-3ed5b229fd5a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:28.117757 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-122b4032-c0e1-4720-b111-dd3df7137e39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:28.130867 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7cb9a0c4-4a04-4bba-8e29-3ed5b229fd5a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.271528 Aug 31 11:09:28.132440 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-122b4032-c0e1-4720-b111-dd3df7137e39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.160348 Aug 31 11:09:28.133090 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 302/553] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:27 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:28.137626 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-58d4ae8a-b9e2-47bf-8e06-303ed35882c2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:28.138226 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-58d4ae8a-b9e2-47bf-8e06-303ed35882c2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:28.141766 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 252/554] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:27 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:28.145630 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-58d4ae8a-b9e2-47bf-8e06-303ed35882c2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:28.146326 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-58d4ae8a-b9e2-47bf-8e06-303ed35882c2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:28.146937 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-58d4ae8a-b9e2-47bf-8e06-303ed35882c2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:28.147793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-58d4ae8a-b9e2-47bf-8e06-303ed35882c2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:28.148450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-58d4ae8a-b9e2-47bf-8e06-303ed35882c2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:28.149042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-58d4ae8a-b9e2-47bf-8e06-303ed35882c2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:28.293193 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-58d4ae8a-b9e2-47bf-8e06-303ed35882c2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:28.301931 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-58d4ae8a-b9e2-47bf-8e06-303ed35882c2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1367 microversion: 2.1 time: 0.167731 Aug 31 11:09:28.303307 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 303/555] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:28 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:28.438133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-c01249ad-0005-4144-869b-4fba2e1dacf2 req-83c5d7ae-d2fb-413d-ab77-ff448255aad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f70e795-e50c-414e-b302-2b818ce84337", "name": "network-vif-plugged", "status": "completed", "tag": "1facded0-b145-4c4f-a2ec-cbef8e6d0174"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:28.448967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-c01249ad-0005-4144-869b-4fba2e1dacf2 req-83c5d7ae-d2fb-413d-ab77-ff448255aad0 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:28.449470 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-c01249ad-0005-4144-869b-4fba2e1dacf2 req-83c5d7ae-d2fb-413d-ab77-ff448255aad0 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:28.449896 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-c01249ad-0005-4144-869b-4fba2e1dacf2 req-83c5d7ae-d2fb-413d-ab77-ff448255aad0 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:28.461795 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-c01249ad-0005-4144-869b-4fba2e1dacf2 req-83c5d7ae-d2fb-413d-ab77-ff448255aad0 service nova] Creating event network-vif-plugged:1facded0-b145-4c4f-a2ec-cbef8e6d0174 for instance 2f70e795-e50c-414e-b302-2b818ce84337 on hv-cinder-85535 Aug 31 11:09:28.466598 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-c01249ad-0005-4144-869b-4fba2e1dacf2 req-83c5d7ae-d2fb-413d-ab77-ff448255aad0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032330 Aug 31 11:09:28.467343 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 253/556] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:28.750442 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f84da56d-597f-477f-aece-3ea598397654 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:28.751181 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f84da56d-597f-477f-aece-3ea598397654 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:28.753435 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:28.754245 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=6 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:28.760915 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f84da56d-597f-477f-aece-3ea598397654 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:28.761406 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f84da56d-597f-477f-aece-3ea598397654 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:28.761847 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f84da56d-597f-477f-aece-3ea598397654 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:28.762544 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f84da56d-597f-477f-aece-3ea598397654 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:28.762999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f84da56d-597f-477f-aece-3ea598397654 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:28.763422 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f84da56d-597f-477f-aece-3ea598397654 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:28.779848 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=100 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:28.904787 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f84da56d-597f-477f-aece-3ea598397654 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:28.914016 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f84da56d-597f-477f-aece-3ea598397654 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1734 microversion: 2.1 time: 0.167443 Aug 31 11:09:28.914582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 304/557] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:28 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:29.152115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=6 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:29.156822 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d17a5ea8-8eda-4967-bb13-36dfb7fc6773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:29.157553 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d17a5ea8-8eda-4967-bb13-36dfb7fc6773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:29.163061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-939c1401-17b0-4ff5-a7fc-77210348e43a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:29.163765 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-939c1401-17b0-4ff5-a7fc-77210348e43a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:29.165497 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d17a5ea8-8eda-4967-bb13-36dfb7fc6773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:29.165991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d17a5ea8-8eda-4967-bb13-36dfb7fc6773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:29.166427 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d17a5ea8-8eda-4967-bb13-36dfb7fc6773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:29.167138 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d17a5ea8-8eda-4967-bb13-36dfb7fc6773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:29.167594 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d17a5ea8-8eda-4967-bb13-36dfb7fc6773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:29.168038 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d17a5ea8-8eda-4967-bb13-36dfb7fc6773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:29.170279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-939c1401-17b0-4ff5-a7fc-77210348e43a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:29.170952 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-939c1401-17b0-4ff5-a7fc-77210348e43a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:29.171391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-939c1401-17b0-4ff5-a7fc-77210348e43a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:29.172393 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-939c1401-17b0-4ff5-a7fc-77210348e43a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:29.172843 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-939c1401-17b0-4ff5-a7fc-77210348e43a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:29.173267 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-939c1401-17b0-4ff5-a7fc-77210348e43a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:29.311497 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d17a5ea8-8eda-4967-bb13-36dfb7fc6773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:29.320090 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d17a5ea8-8eda-4967-bb13-36dfb7fc6773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1725 microversion: 2.1 time: 0.168796 Aug 31 11:09:29.320594 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 254/558] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:29 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:29.322729 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-939c1401-17b0-4ff5-a7fc-77210348e43a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:29.325256 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0d6fe20f-60da-40d2-a3b4-642baed97945 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:29.325858 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0d6fe20f-60da-40d2-a3b4-642baed97945 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:29.332421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-939c1401-17b0-4ff5-a7fc-77210348e43a tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.173792 Aug 31 11:09:29.332977 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d6fe20f-60da-40d2-a3b4-642baed97945 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:29.335647 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d6fe20f-60da-40d2-a3b4-642baed97945 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:29.335799 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 305/559] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:29 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:29.335897 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d6fe20f-60da-40d2-a3b4-642baed97945 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:29.335897 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d6fe20f-60da-40d2-a3b4-642baed97945 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:29.336650 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d6fe20f-60da-40d2-a3b4-642baed97945 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:29.337377 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0d6fe20f-60da-40d2-a3b4-642baed97945 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:29.480314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0d6fe20f-60da-40d2-a3b4-642baed97945 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:29.487903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0d6fe20f-60da-40d2-a3b4-642baed97945 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1367 microversion: 2.1 time: 0.166190 Aug 31 11:09:29.488565 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 255/560] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:29 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:29.935916 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-68936aa9-7ba4-4059-bd6e-acd88b0a1adb tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:29.936546 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-68936aa9-7ba4-4059-bd6e-acd88b0a1adb tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:29.943921 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68936aa9-7ba4-4059-bd6e-acd88b0a1adb tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:29.944439 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68936aa9-7ba4-4059-bd6e-acd88b0a1adb tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:29.944866 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68936aa9-7ba4-4059-bd6e-acd88b0a1adb tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:29.945545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68936aa9-7ba4-4059-bd6e-acd88b0a1adb tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:29.945988 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68936aa9-7ba4-4059-bd6e-acd88b0a1adb tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:29.946404 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-68936aa9-7ba4-4059-bd6e-acd88b0a1adb tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:30.086376 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-68936aa9-7ba4-4059-bd6e-acd88b0a1adb tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:30.096316 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-68936aa9-7ba4-4059-bd6e-acd88b0a1adb tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1734 microversion: 2.1 time: 0.163975 Aug 31 11:09:30.096910 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 306/561] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:29 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:30.342918 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0ac701e6-0ea3-4475-8002-1d94f57809c0 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:30.343527 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0ac701e6-0ea3-4475-8002-1d94f57809c0 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:30.350288 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0ac701e6-0ea3-4475-8002-1d94f57809c0 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:30.350778 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0ac701e6-0ea3-4475-8002-1d94f57809c0 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:30.351212 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0ac701e6-0ea3-4475-8002-1d94f57809c0 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:30.351912 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0ac701e6-0ea3-4475-8002-1d94f57809c0 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:30.352407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0ac701e6-0ea3-4475-8002-1d94f57809c0 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:30.352830 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0ac701e6-0ea3-4475-8002-1d94f57809c0 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:30.367246 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8bf1a9f2-f1cd-453e-b716-fbf5da09bfff tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:30.367847 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8bf1a9f2-f1cd-453e-b716-fbf5da09bfff tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:30.373956 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8bf1a9f2-f1cd-453e-b716-fbf5da09bfff tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:30.374428 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8bf1a9f2-f1cd-453e-b716-fbf5da09bfff tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:30.374859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8bf1a9f2-f1cd-453e-b716-fbf5da09bfff tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:30.375559 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8bf1a9f2-f1cd-453e-b716-fbf5da09bfff tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:30.376029 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8bf1a9f2-f1cd-453e-b716-fbf5da09bfff tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:30.376455 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8bf1a9f2-f1cd-453e-b716-fbf5da09bfff tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:30.493491 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0ac701e6-0ea3-4475-8002-1d94f57809c0 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:30.504910 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0ac701e6-0ea3-4475-8002-1d94f57809c0 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1702 microversion: 2.1 time: 0.163452 Aug 31 11:09:30.504910 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 256/562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:30 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1702 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:30.521782 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-339cb597-9597-4ccd-8740-11a207c6bd8d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:30.522393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-339cb597-9597-4ccd-8740-11a207c6bd8d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:30.528537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-339cb597-9597-4ccd-8740-11a207c6bd8d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:30.529010 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-339cb597-9597-4ccd-8740-11a207c6bd8d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:30.529442 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-339cb597-9597-4ccd-8740-11a207c6bd8d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:30.530143 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-339cb597-9597-4ccd-8740-11a207c6bd8d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:30.530345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8bf1a9f2-f1cd-453e-b716-fbf5da09bfff tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:30.530592 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-339cb597-9597-4ccd-8740-11a207c6bd8d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:30.531013 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-339cb597-9597-4ccd-8740-11a207c6bd8d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:30.539423 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8bf1a9f2-f1cd-453e-b716-fbf5da09bfff tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.175928 Aug 31 11:09:30.540307 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 307/563] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:30 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:30.544977 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1ed8a558-b74a-42fa-a340-1dd7825fa453 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:30.551972 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1ed8a558-b74a-42fa-a340-1dd7825fa453 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:30.552499 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1ed8a558-b74a-42fa-a340-1dd7825fa453 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:30.552931 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1ed8a558-b74a-42fa-a340-1dd7825fa453 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:30.618523 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1ed8a558-b74a-42fa-a340-1dd7825fa453 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Going to try to start instance {{(pid=120654) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 11:09:30.663135 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1ed8a558-b74a-42fa-a340-1dd7825fa453 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "POST /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/action" status: 202 len: 0 microversion: 2.1 time: 0.121596 Aug 31 11:09:30.663741 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 308/564] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:09:30 2022] POST /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:09:30.672955 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-496a26be-7920-40ee-a148-a99214bb1773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:30.674202 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-339cb597-9597-4ccd-8740-11a207c6bd8d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:30.674390 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-496a26be-7920-40ee-a148-a99214bb1773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:30.680734 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-496a26be-7920-40ee-a148-a99214bb1773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:30.681218 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-496a26be-7920-40ee-a148-a99214bb1773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:30.681642 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-496a26be-7920-40ee-a148-a99214bb1773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:30.682085 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-339cb597-9597-4ccd-8740-11a207c6bd8d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1556 microversion: 2.1 time: 0.164719 Aug 31 11:09:30.682331 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-496a26be-7920-40ee-a148-a99214bb1773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:30.682663 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 257/565] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:30 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:30.682783 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-496a26be-7920-40ee-a148-a99214bb1773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:30.683181 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-496a26be-7920-40ee-a148-a99214bb1773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:30.703914 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e3df8742-44b0-4916-8638-ff3f852f17b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:30.704540 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e3df8742-44b0-4916-8638-ff3f852f17b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:30.711875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3df8742-44b0-4916-8638-ff3f852f17b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:30.712503 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3df8742-44b0-4916-8638-ff3f852f17b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:30.713058 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3df8742-44b0-4916-8638-ff3f852f17b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:30.713907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3df8742-44b0-4916-8638-ff3f852f17b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:30.714432 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3df8742-44b0-4916-8638-ff3f852f17b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:30.714926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3df8742-44b0-4916-8638-ff3f852f17b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:30.821076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e3df8742-44b0-4916-8638-ff3f852f17b4 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121007 Aug 31 11:09:30.821852 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 258/566] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 11:09:30 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:09:30.850022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-496a26be-7920-40ee-a148-a99214bb1773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:30.859353 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-496a26be-7920-40ee-a148-a99214bb1773 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1711 microversion: 2.1 time: 0.190852 Aug 31 11:09:30.859940 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 309/567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:30 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1711 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:31.117895 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b57e46ca-c5a7-4c13-ba61-85da5962be30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:31.118615 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b57e46ca-c5a7-4c13-ba61-85da5962be30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:31.124827 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b57e46ca-c5a7-4c13-ba61-85da5962be30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:31.125319 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b57e46ca-c5a7-4c13-ba61-85da5962be30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:31.125758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b57e46ca-c5a7-4c13-ba61-85da5962be30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:31.126461 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b57e46ca-c5a7-4c13-ba61-85da5962be30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:31.127475 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b57e46ca-c5a7-4c13-ba61-85da5962be30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:31.127906 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b57e46ca-c5a7-4c13-ba61-85da5962be30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:31.562018 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-647ac396-d08d-45d6-ae9b-53d4c146f09f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:31.562632 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-647ac396-d08d-45d6-ae9b-53d4c146f09f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:31.569684 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-647ac396-d08d-45d6-ae9b-53d4c146f09f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:31.570275 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-647ac396-d08d-45d6-ae9b-53d4c146f09f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:31.570780 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-647ac396-d08d-45d6-ae9b-53d4c146f09f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:31.571475 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-647ac396-d08d-45d6-ae9b-53d4c146f09f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:31.571935 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-647ac396-d08d-45d6-ae9b-53d4c146f09f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:31.572395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-647ac396-d08d-45d6-ae9b-53d4c146f09f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:31.726659 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-647ac396-d08d-45d6-ae9b-53d4c146f09f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:31.736435 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-647ac396-d08d-45d6-ae9b-53d4c146f09f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.178090 Aug 31 11:09:31.740064 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 310/568] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:31 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:31.765296 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b57e46ca-c5a7-4c13-ba61-85da5962be30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:31.775515 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b57e46ca-c5a7-4c13-ba61-85da5962be30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1734 microversion: 2.1 time: 0.661367 Aug 31 11:09:31.776118 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 259/569] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:31 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1734 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:31.882102 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-88f5469f-9255-4003-84bd-361ee2bdc6bb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:31.882710 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-88f5469f-9255-4003-84bd-361ee2bdc6bb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:31.888780 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-88f5469f-9255-4003-84bd-361ee2bdc6bb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:31.889275 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-88f5469f-9255-4003-84bd-361ee2bdc6bb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:31.889712 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-88f5469f-9255-4003-84bd-361ee2bdc6bb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:31.890423 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-88f5469f-9255-4003-84bd-361ee2bdc6bb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:31.890878 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-88f5469f-9255-4003-84bd-361ee2bdc6bb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:31.891302 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-88f5469f-9255-4003-84bd-361ee2bdc6bb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:32.030800 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-88f5469f-9255-4003-84bd-361ee2bdc6bb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:32.040233 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-88f5469f-9255-4003-84bd-361ee2bdc6bb tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1711 microversion: 2.1 time: 0.161773 Aug 31 11:09:32.040845 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 311/570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:31 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1711 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:32.530569 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-84cfa1d4-ae55-4da5-a4a7-68dca3b188a5 req-7fa0126e-f8a9-4076-b4dd-b4b73c8adbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f70e795-e50c-414e-b302-2b818ce84337", "tag": "1facded0-b145-4c4f-a2ec-cbef8e6d0174"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:32.541947 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-84cfa1d4-ae55-4da5-a4a7-68dca3b188a5 req-7fa0126e-f8a9-4076-b4dd-b4b73c8adbc8 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:32.542431 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-84cfa1d4-ae55-4da5-a4a7-68dca3b188a5 req-7fa0126e-f8a9-4076-b4dd-b4b73c8adbc8 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:32.542865 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-84cfa1d4-ae55-4da5-a4a7-68dca3b188a5 req-7fa0126e-f8a9-4076-b4dd-b4b73c8adbc8 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:32.555597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-84cfa1d4-ae55-4da5-a4a7-68dca3b188a5 req-7fa0126e-f8a9-4076-b4dd-b4b73c8adbc8 service nova] Creating event network-changed:1facded0-b145-4c4f-a2ec-cbef8e6d0174 for instance 2f70e795-e50c-414e-b302-2b818ce84337 on hv-cinder-85535 Aug 31 11:09:32.561692 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-84cfa1d4-ae55-4da5-a4a7-68dca3b188a5 req-7fa0126e-f8a9-4076-b4dd-b4b73c8adbc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034720 Aug 31 11:09:32.562300 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 260/571] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:32.761742 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f684d164-36eb-4fd3-a689-c48393e52701 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:32.762594 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f684d164-36eb-4fd3-a689-c48393e52701 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:32.770186 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f684d164-36eb-4fd3-a689-c48393e52701 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:32.770683 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f684d164-36eb-4fd3-a689-c48393e52701 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:32.771276 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f684d164-36eb-4fd3-a689-c48393e52701 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:32.772776 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f684d164-36eb-4fd3-a689-c48393e52701 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:32.773661 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f684d164-36eb-4fd3-a689-c48393e52701 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:32.774169 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f684d164-36eb-4fd3-a689-c48393e52701 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:32.799670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4ab9b5ec-ab66-4782-b496-1409ea8451ef tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:32.801187 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-4ab9b5ec-ab66-4782-b496-1409ea8451ef tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:32.818902 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4ab9b5ec-ab66-4782-b496-1409ea8451ef tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:32.821227 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4ab9b5ec-ab66-4782-b496-1409ea8451ef tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:32.821762 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4ab9b5ec-ab66-4782-b496-1409ea8451ef tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:32.822632 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4ab9b5ec-ab66-4782-b496-1409ea8451ef tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:32.823161 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4ab9b5ec-ab66-4782-b496-1409ea8451ef tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:32.823825 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4ab9b5ec-ab66-4782-b496-1409ea8451ef tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:32.940615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f684d164-36eb-4fd3-a689-c48393e52701 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:32.949487 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f684d164-36eb-4fd3-a689-c48393e52701 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.195126 Aug 31 11:09:32.950473 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 312/572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:32 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:32.985855 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4ab9b5ec-ab66-4782-b496-1409ea8451ef tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:32.994664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4ab9b5ec-ab66-4782-b496-1409ea8451ef tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1734 microversion: 2.1 time: 0.201071 Aug 31 11:09:32.995164 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 261/573] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:32 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:33.063067 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-02c2ae12-c3ee-44e6-9ceb-3589a103e346 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:33.063682 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-02c2ae12-c3ee-44e6-9ceb-3589a103e346 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:33.070089 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-02c2ae12-c3ee-44e6-9ceb-3589a103e346 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:33.070576 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-02c2ae12-c3ee-44e6-9ceb-3589a103e346 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:33.071019 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-02c2ae12-c3ee-44e6-9ceb-3589a103e346 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:33.071722 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-02c2ae12-c3ee-44e6-9ceb-3589a103e346 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:33.072205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-02c2ae12-c3ee-44e6-9ceb-3589a103e346 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:33.072656 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-02c2ae12-c3ee-44e6-9ceb-3589a103e346 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:33.219797 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-02c2ae12-c3ee-44e6-9ceb-3589a103e346 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:33.229300 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-02c2ae12-c3ee-44e6-9ceb-3589a103e346 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1711 microversion: 2.1 time: 0.170130 Aug 31 11:09:33.229895 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 313/574] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:33 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1711 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:33.974309 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-60afdc2b-6883-4cda-a9b1-8b2db5428259 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:33.974970 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-60afdc2b-6883-4cda-a9b1-8b2db5428259 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:33.977442 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:33.982564 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-60afdc2b-6883-4cda-a9b1-8b2db5428259 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:33.983139 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-60afdc2b-6883-4cda-a9b1-8b2db5428259 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:33.983552 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-60afdc2b-6883-4cda-a9b1-8b2db5428259 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:33.984286 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-60afdc2b-6883-4cda-a9b1-8b2db5428259 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:33.984775 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-60afdc2b-6883-4cda-a9b1-8b2db5428259 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:33.985550 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-60afdc2b-6883-4cda-a9b1-8b2db5428259 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:34.016553 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-bc4a9769-b723-40a8-abd3-fa0afc9788e8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:34.017335 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-bc4a9769-b723-40a8-abd3-fa0afc9788e8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:34.027777 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc4a9769-b723-40a8-abd3-fa0afc9788e8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:34.028313 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc4a9769-b723-40a8-abd3-fa0afc9788e8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:34.028756 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc4a9769-b723-40a8-abd3-fa0afc9788e8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:34.029491 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc4a9769-b723-40a8-abd3-fa0afc9788e8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:34.029952 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc4a9769-b723-40a8-abd3-fa0afc9788e8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:34.030373 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc4a9769-b723-40a8-abd3-fa0afc9788e8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:34.153962 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-60afdc2b-6883-4cda-a9b1-8b2db5428259 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:34.163806 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-60afdc2b-6883-4cda-a9b1-8b2db5428259 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.195088 Aug 31 11:09:34.164920 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 262/575] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:33 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:34.182431 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-bc4a9769-b723-40a8-abd3-fa0afc9788e8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:34.193852 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-bc4a9769-b723-40a8-abd3-fa0afc9788e8 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1734 microversion: 2.1 time: 0.180690 Aug 31 11:09:34.194915 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 314/576] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:34 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:34.250601 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-525b4e43-94b2-402b-b0da-a51b4d4636b3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:34.251211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-525b4e43-94b2-402b-b0da-a51b4d4636b3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:34.257253 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-525b4e43-94b2-402b-b0da-a51b4d4636b3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:34.257738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-525b4e43-94b2-402b-b0da-a51b4d4636b3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:34.258176 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-525b4e43-94b2-402b-b0da-a51b4d4636b3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:34.258873 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-525b4e43-94b2-402b-b0da-a51b4d4636b3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:34.259325 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-525b4e43-94b2-402b-b0da-a51b4d4636b3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:34.259747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-525b4e43-94b2-402b-b0da-a51b4d4636b3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:34.398963 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-525b4e43-94b2-402b-b0da-a51b4d4636b3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:34.409263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-525b4e43-94b2-402b-b0da-a51b4d4636b3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1715 microversion: 2.1 time: 0.162481 Aug 31 11:09:34.409846 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 263/577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:34 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:35.186281 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8d0808e4-e31c-4da6-a2a2-e8df7630fe72 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:35.186890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8d0808e4-e31c-4da6-a2a2-e8df7630fe72 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:35.194153 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8d0808e4-e31c-4da6-a2a2-e8df7630fe72 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:35.194634 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8d0808e4-e31c-4da6-a2a2-e8df7630fe72 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:35.195068 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8d0808e4-e31c-4da6-a2a2-e8df7630fe72 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:35.195762 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8d0808e4-e31c-4da6-a2a2-e8df7630fe72 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:35.196248 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8d0808e4-e31c-4da6-a2a2-e8df7630fe72 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:35.196668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8d0808e4-e31c-4da6-a2a2-e8df7630fe72 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:35.214684 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-73274dcd-0416-4da6-a1c2-3770b776cbe5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:35.215296 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-73274dcd-0416-4da6-a1c2-3770b776cbe5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:35.221898 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-73274dcd-0416-4da6-a1c2-3770b776cbe5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:35.222391 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-73274dcd-0416-4da6-a1c2-3770b776cbe5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:35.222834 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-73274dcd-0416-4da6-a1c2-3770b776cbe5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:35.223541 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-73274dcd-0416-4da6-a1c2-3770b776cbe5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:35.223997 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-73274dcd-0416-4da6-a1c2-3770b776cbe5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:35.224457 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-73274dcd-0416-4da6-a1c2-3770b776cbe5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:35.355695 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8d0808e4-e31c-4da6-a2a2-e8df7630fe72 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:35.364816 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8d0808e4-e31c-4da6-a2a2-e8df7630fe72 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1755 microversion: 2.1 time: 0.182315 Aug 31 11:09:35.365395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 315/578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:35 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:35.380089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-73274dcd-0416-4da6-a1c2-3770b776cbe5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:35.388345 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-73274dcd-0416-4da6-a1c2-3770b776cbe5 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1734 microversion: 2.1 time: 0.177531 Aug 31 11:09:35.388934 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 264/579] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:35 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:36.386702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8c141735-7d96-4aa5-ab90-2c63abdd2c49 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:36.387315 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8c141735-7d96-4aa5-ab90-2c63abdd2c49 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:36.395093 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8c141735-7d96-4aa5-ab90-2c63abdd2c49 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:36.395579 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8c141735-7d96-4aa5-ab90-2c63abdd2c49 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:36.396039 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8c141735-7d96-4aa5-ab90-2c63abdd2c49 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:36.396739 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8c141735-7d96-4aa5-ab90-2c63abdd2c49 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:36.397186 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8c141735-7d96-4aa5-ab90-2c63abdd2c49 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:36.397607 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8c141735-7d96-4aa5-ab90-2c63abdd2c49 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:36.409884 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-87a0c57b-4a8e-420a-8fa5-e7c309c3f9ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:36.410738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-87a0c57b-4a8e-420a-8fa5-e7c309c3f9ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:36.417283 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-87a0c57b-4a8e-420a-8fa5-e7c309c3f9ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:36.417763 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-87a0c57b-4a8e-420a-8fa5-e7c309c3f9ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:36.418195 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-87a0c57b-4a8e-420a-8fa5-e7c309c3f9ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:36.418894 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-87a0c57b-4a8e-420a-8fa5-e7c309c3f9ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:36.419343 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-87a0c57b-4a8e-420a-8fa5-e7c309c3f9ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:36.419771 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-87a0c57b-4a8e-420a-8fa5-e7c309c3f9ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:36.550626 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8c141735-7d96-4aa5-ab90-2c63abdd2c49 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:36.558867 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8c141735-7d96-4aa5-ab90-2c63abdd2c49 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1758 microversion: 2.1 time: 0.175997 Aug 31 11:09:36.559447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 316/580] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:36 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:36.559876 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-87a0c57b-4a8e-420a-8fa5-e7c309c3f9ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:36.569925 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-87a0c57b-4a8e-420a-8fa5-e7c309c3f9ae tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1734 microversion: 2.1 time: 0.163794 Aug 31 11:09:36.570506 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 265/581] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:36 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:37.590905 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8e010c7f-4b8a-4f34-9799-0e5e4a887301 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:37.591434 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8e010c7f-4b8a-4f34-9799-0e5e4a887301 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:37.598080 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e010c7f-4b8a-4f34-9799-0e5e4a887301 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:37.598552 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e010c7f-4b8a-4f34-9799-0e5e4a887301 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:37.598980 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e010c7f-4b8a-4f34-9799-0e5e4a887301 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:37.599664 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e010c7f-4b8a-4f34-9799-0e5e4a887301 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:37.600144 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e010c7f-4b8a-4f34-9799-0e5e4a887301 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:37.600559 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e010c7f-4b8a-4f34-9799-0e5e4a887301 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:37.737463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8e010c7f-4b8a-4f34-9799-0e5e4a887301 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:37.745887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8e010c7f-4b8a-4f34-9799-0e5e4a887301 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1734 microversion: 2.1 time: 0.158966 Aug 31 11:09:37.746451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 317/582] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:37 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:38.766794 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0469e037-3e7b-46e3-aabc-2339bbae9071 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:38.767984 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0469e037-3e7b-46e3-aabc-2339bbae9071 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:38.774711 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0469e037-3e7b-46e3-aabc-2339bbae9071 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:38.775193 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0469e037-3e7b-46e3-aabc-2339bbae9071 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:38.775637 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0469e037-3e7b-46e3-aabc-2339bbae9071 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:38.776386 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0469e037-3e7b-46e3-aabc-2339bbae9071 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:38.776839 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0469e037-3e7b-46e3-aabc-2339bbae9071 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:38.777262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0469e037-3e7b-46e3-aabc-2339bbae9071 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:38.915068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0469e037-3e7b-46e3-aabc-2339bbae9071 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:38.923868 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0469e037-3e7b-46e3-aabc-2339bbae9071 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1734 microversion: 2.1 time: 0.160366 Aug 31 11:09:38.924523 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 266/583] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:38 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:39.944997 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-aaf269d1-4684-41ee-8135-0ff7942faa38 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:39.945618 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-aaf269d1-4684-41ee-8135-0ff7942faa38 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:39.952281 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-aaf269d1-4684-41ee-8135-0ff7942faa38 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:39.952767 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-aaf269d1-4684-41ee-8135-0ff7942faa38 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:39.953204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-aaf269d1-4684-41ee-8135-0ff7942faa38 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:39.953900 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-aaf269d1-4684-41ee-8135-0ff7942faa38 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:39.954348 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-aaf269d1-4684-41ee-8135-0ff7942faa38 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:39.955367 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-aaf269d1-4684-41ee-8135-0ff7942faa38 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:40.095150 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-aaf269d1-4684-41ee-8135-0ff7942faa38 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:40.103671 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-aaf269d1-4684-41ee-8135-0ff7942faa38 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1734 microversion: 2.1 time: 0.162542 Aug 31 11:09:40.104269 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 318/584] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:39 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:41.125091 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-737e4fbe-3f5d-4e1c-96bc-4a2f63dba798 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:41.125632 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-737e4fbe-3f5d-4e1c-96bc-4a2f63dba798 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:41.132810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-737e4fbe-3f5d-4e1c-96bc-4a2f63dba798 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:41.133283 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-737e4fbe-3f5d-4e1c-96bc-4a2f63dba798 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:41.133718 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-737e4fbe-3f5d-4e1c-96bc-4a2f63dba798 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:41.134408 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-737e4fbe-3f5d-4e1c-96bc-4a2f63dba798 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:41.134844 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-737e4fbe-3f5d-4e1c-96bc-4a2f63dba798 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:41.135262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-737e4fbe-3f5d-4e1c-96bc-4a2f63dba798 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:41.139319 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:41.273285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-737e4fbe-3f5d-4e1c-96bc-4a2f63dba798 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:41.281489 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-737e4fbe-3f5d-4e1c-96bc-4a2f63dba798 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1734 microversion: 2.1 time: 0.160315 Aug 31 11:09:41.282047 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 267/585] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:41 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:42.303085 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d78f65f3-8401-4eeb-b424-d81e8a598a67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:42.303696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d78f65f3-8401-4eeb-b424-d81e8a598a67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:42.310231 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d78f65f3-8401-4eeb-b424-d81e8a598a67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:42.310714 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d78f65f3-8401-4eeb-b424-d81e8a598a67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:42.311148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d78f65f3-8401-4eeb-b424-d81e8a598a67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:42.311841 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d78f65f3-8401-4eeb-b424-d81e8a598a67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:42.312344 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d78f65f3-8401-4eeb-b424-d81e8a598a67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:42.312762 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d78f65f3-8401-4eeb-b424-d81e8a598a67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:42.448101 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d78f65f3-8401-4eeb-b424-d81e8a598a67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:42.457319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d78f65f3-8401-4eeb-b424-d81e8a598a67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1714 microversion: 2.1 time: 0.158126 Aug 31 11:09:42.457920 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 319/586] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:42 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:42.572823 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ca3446b7-c4ba-4b3e-bd04-4d8640e17ea6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:42.573388 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ca3446b7-c4ba-4b3e-bd04-4d8640e17ea6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:42.579659 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ca3446b7-c4ba-4b3e-bd04-4d8640e17ea6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:42.580177 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ca3446b7-c4ba-4b3e-bd04-4d8640e17ea6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:42.580606 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ca3446b7-c4ba-4b3e-bd04-4d8640e17ea6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:42.581285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ca3446b7-c4ba-4b3e-bd04-4d8640e17ea6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:42.581738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ca3446b7-c4ba-4b3e-bd04-4d8640e17ea6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:42.582150 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ca3446b7-c4ba-4b3e-bd04-4d8640e17ea6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:42.711973 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-ca3446b7-c4ba-4b3e-bd04-4d8640e17ea6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] HTTP exception thrown: Cannot 'detach_volume' instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 while it is in vm_state rescued Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ca3446b7-c4ba-4b3e-bd04-4d8640e17ea6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Request method failure captured: Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: DELETE /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments/48486b7c-e31a-4f04-821c-9e42e2234577 HTTP/1.1 Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0B3pxnNtheXxMA108K-k3aets4iDu1xumVDmbwkNyulZyujoyRzznHgfG-H745bhKzmC_tincuwf2-1k2WKMJBp3v_5eKOI2HXs-BSvvXLY5ppaBAEot0sxP3oNxqcqTMTOtvZEHhj2BQuPOndfD2LNaMReJc2hJWcOZYGeTmQONow Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 9ceec51e430e4a00b407068a2243be63 Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:09:42.713957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:09:42.715303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ceec51e430e4a00b407068a2243be63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ceec51e430e4a00b407068a2243be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ceec51e430e4a00b407068a2243be63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ceec51e430e4a00b407068a2243be63"}]}] Aug 31 11:09:42.715303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:09:42.715303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 9ceec51e430e4a00b407068a2243be63 Aug 31 11:09:42.715303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:09:42.715303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-ServerRescueNegativeTestJSON-92711221-project Aug 31 11:09:42.715303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:09:42.715303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:09:42.715303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 19643be9952649aba81e61d5d55290c4 Aug 31 11:09:42.715303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-ServerRescueNegativeTestJSON-92711221-project Aug 31 11:09:42.715303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:09:42.715303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Cannot 'detach_volume' instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 while it is in vm_state rescued Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'server_id': 'f01be6c4-bf01-4970-87ca-7c8e3cf14524', 'id': '48486b7c-e31a-4f04-821c-9e42e2234577'} Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:09:42.716100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 while it is in vm_state rescued Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 while it is in vm_state rescued Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:42.717658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ca3446b7-c4ba-4b3e-bd04-4d8640e17ea6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Returning 409 to user: Cannot 'detach_volume' instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 while it is in vm_state rescued {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:09:42.718759 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ca3446b7-c4ba-4b3e-bd04-4d8640e17ea6 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments/48486b7c-e31a-4f04-821c-9e42e2234577" status: 409 len: 152 microversion: 2.1 time: 0.146555 Aug 31 11:09:42.718759 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 268/587] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 11:09:42 2022] DELETE /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments/48486b7c-e31a-4f04-821c-9e42e2234577 => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 11:09:42.724210 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a7486267-ffeb-4be5-8359-6ce07d89132c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:42.724734 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a7486267-ffeb-4be5-8359-6ce07d89132c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:42.730568 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7486267-ffeb-4be5-8359-6ce07d89132c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:42.731041 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7486267-ffeb-4be5-8359-6ce07d89132c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:42.731467 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7486267-ffeb-4be5-8359-6ce07d89132c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:42.732193 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7486267-ffeb-4be5-8359-6ce07d89132c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:42.732668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7486267-ffeb-4be5-8359-6ce07d89132c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:42.733080 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7486267-ffeb-4be5-8359-6ce07d89132c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:42.736196 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:42.804102 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a7486267-ffeb-4be5-8359-6ce07d89132c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "POST /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/action" status: 202 len: 0 microversion: 2.1 time: 0.083516 Aug 31 11:09:42.804745 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 320/588] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:09:42 2022] POST /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:09:42.813681 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-50fc1675-3a72-4a2f-aff2-4f26fefc0a89 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:42.815476 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-50fc1675-3a72-4a2f-aff2-4f26fefc0a89 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:42.821928 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-50fc1675-3a72-4a2f-aff2-4f26fefc0a89 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:42.822365 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-50fc1675-3a72-4a2f-aff2-4f26fefc0a89 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:42.822952 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-50fc1675-3a72-4a2f-aff2-4f26fefc0a89 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:42.823677 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-50fc1675-3a72-4a2f-aff2-4f26fefc0a89 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:42.824295 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-50fc1675-3a72-4a2f-aff2-4f26fefc0a89 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:42.824756 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-50fc1675-3a72-4a2f-aff2-4f26fefc0a89 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:43.040298 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-50fc1675-3a72-4a2f-aff2-4f26fefc0a89 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:43.049295 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-50fc1675-3a72-4a2f-aff2-4f26fefc0a89 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1722 microversion: 2.1 time: 0.239512 Aug 31 11:09:43.050110 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 269/589] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:42 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:44.071135 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-44d89a01-46a9-40cc-b321-54cd469a4237 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:44.071742 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-44d89a01-46a9-40cc-b321-54cd469a4237 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:44.077915 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-44d89a01-46a9-40cc-b321-54cd469a4237 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:44.078396 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-44d89a01-46a9-40cc-b321-54cd469a4237 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:44.078847 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-44d89a01-46a9-40cc-b321-54cd469a4237 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:44.080173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-44d89a01-46a9-40cc-b321-54cd469a4237 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:44.080625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-44d89a01-46a9-40cc-b321-54cd469a4237 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:44.081052 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-44d89a01-46a9-40cc-b321-54cd469a4237 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:44.215296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-44d89a01-46a9-40cc-b321-54cd469a4237 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:44.224722 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-44d89a01-46a9-40cc-b321-54cd469a4237 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1722 microversion: 2.1 time: 0.158409 Aug 31 11:09:44.225289 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 321/590] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:44 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:45.244728 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a93c9568-edba-44e6-9f8f-4820fb8cd89e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:45.245327 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a93c9568-edba-44e6-9f8f-4820fb8cd89e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:45.251704 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a93c9568-edba-44e6-9f8f-4820fb8cd89e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:45.252204 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a93c9568-edba-44e6-9f8f-4820fb8cd89e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:45.252852 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a93c9568-edba-44e6-9f8f-4820fb8cd89e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:45.253566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a93c9568-edba-44e6-9f8f-4820fb8cd89e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:45.253993 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a93c9568-edba-44e6-9f8f-4820fb8cd89e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:45.254409 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a93c9568-edba-44e6-9f8f-4820fb8cd89e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:45.388635 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a93c9568-edba-44e6-9f8f-4820fb8cd89e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:45.397176 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a93c9568-edba-44e6-9f8f-4820fb8cd89e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1722 microversion: 2.1 time: 0.156307 Aug 31 11:09:45.398017 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 270/591] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:45 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:45.484557 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1e869be7-8f3b-46ef-803f-fffdcb2aefd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:45.485194 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1e869be7-8f3b-46ef-803f-fffdcb2aefd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:45.492438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e869be7-8f3b-46ef-803f-fffdcb2aefd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:45.492885 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e869be7-8f3b-46ef-803f-fffdcb2aefd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:45.493320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e869be7-8f3b-46ef-803f-fffdcb2aefd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:45.494011 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e869be7-8f3b-46ef-803f-fffdcb2aefd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:45.494459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e869be7-8f3b-46ef-803f-fffdcb2aefd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:45.494924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1e869be7-8f3b-46ef-803f-fffdcb2aefd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:45.523836 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1e869be7-8f3b-46ef-803f-fffdcb2aefd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-volume_attachments/40eff4d2-944b-4d7b-ba1e-a3a2688992cc" status: 200 len: 194 microversion: 2.20 time: 0.043386 Aug 31 11:09:45.524453 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 322/592] 10.222.0.20 () {60 vars in 1454 bytes} [Wed Aug 31 11:09:45 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-volume_attachments/40eff4d2-944b-4d7b-ba1e-a3a2688992cc => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:09:45.592736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e86e67a9-ff0f-4ff8-89ed-c0262d7ee128 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:45.593224 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e86e67a9-ff0f-4ff8-89ed-c0262d7ee128 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:45.599662 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e86e67a9-ff0f-4ff8-89ed-c0262d7ee128 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:45.600172 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e86e67a9-ff0f-4ff8-89ed-c0262d7ee128 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:45.600609 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e86e67a9-ff0f-4ff8-89ed-c0262d7ee128 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:45.601300 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e86e67a9-ff0f-4ff8-89ed-c0262d7ee128 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:45.601751 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e86e67a9-ff0f-4ff8-89ed-c0262d7ee128 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:45.602177 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e86e67a9-ff0f-4ff8-89ed-c0262d7ee128 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:45.681514 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-e86e67a9-ff0f-4ff8-89ed-c0262d7ee128 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lazy-loading 'services' on Instance uuid 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:09:45.798694 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e86e67a9-ff0f-4ff8-89ed-c0262d7ee128 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-volume_attachments/40eff4d2-944b-4d7b-ba1e-a3a2688992cc" status: 202 len: 0 microversion: 2.20 time: 0.209625 Aug 31 11:09:45.799291 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 271/593] 10.222.0.20 () {60 vars in 1457 bytes} [Wed Aug 31 11:09:45 2022] DELETE /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-volume_attachments/40eff4d2-944b-4d7b-ba1e-a3a2688992cc => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:09:45.807646 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a03b8203-7770-4134-80d8-e0a73c31b1de tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:45.809904 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a03b8203-7770-4134-80d8-e0a73c31b1de tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:45.816062 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a03b8203-7770-4134-80d8-e0a73c31b1de tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:45.816542 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a03b8203-7770-4134-80d8-e0a73c31b1de tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:45.816971 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a03b8203-7770-4134-80d8-e0a73c31b1de tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:45.817651 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a03b8203-7770-4134-80d8-e0a73c31b1de tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:45.818093 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a03b8203-7770-4134-80d8-e0a73c31b1de tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:45.818508 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a03b8203-7770-4134-80d8-e0a73c31b1de tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:45.848258 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a03b8203-7770-4134-80d8-e0a73c31b1de tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044452 Aug 31 11:09:45.848815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 323/594] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 31 11:09:45 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:09:46.420405 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d1f0edb0-2dcf-48c7-b274-56b9046d84ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:46.421134 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d1f0edb0-2dcf-48c7-b274-56b9046d84ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:46.428034 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d1f0edb0-2dcf-48c7-b274-56b9046d84ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:46.428543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d1f0edb0-2dcf-48c7-b274-56b9046d84ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:46.428985 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d1f0edb0-2dcf-48c7-b274-56b9046d84ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:46.429692 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d1f0edb0-2dcf-48c7-b274-56b9046d84ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:46.430140 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d1f0edb0-2dcf-48c7-b274-56b9046d84ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:46.430558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d1f0edb0-2dcf-48c7-b274-56b9046d84ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:46.569490 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d1f0edb0-2dcf-48c7-b274-56b9046d84ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:46.578485 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d1f0edb0-2dcf-48c7-b274-56b9046d84ab tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1728 microversion: 2.1 time: 0.162775 Aug 31 11:09:46.579138 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 272/595] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:46 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:46.599318 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-339babb8-22ef-4161-be2a-fedb37f71b71 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:46.599979 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-339babb8-22ef-4161-be2a-fedb37f71b71 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:46.606628 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-339babb8-22ef-4161-be2a-fedb37f71b71 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:46.607109 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-339babb8-22ef-4161-be2a-fedb37f71b71 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:46.607539 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-339babb8-22ef-4161-be2a-fedb37f71b71 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:46.608283 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-339babb8-22ef-4161-be2a-fedb37f71b71 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:46.608732 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-339babb8-22ef-4161-be2a-fedb37f71b71 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:46.609182 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-339babb8-22ef-4161-be2a-fedb37f71b71 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:46.693748 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-339babb8-22ef-4161-be2a-fedb37f71b71 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098368 Aug 31 11:09:46.694413 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 324/596] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 11:09:46 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:46.861885 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8eee1ce4-896c-4f38-8fb4-71fbe7e3fb1b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:46.864179 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8eee1ce4-896c-4f38-8fb4-71fbe7e3fb1b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:46.870209 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8eee1ce4-896c-4f38-8fb4-71fbe7e3fb1b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:46.870692 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8eee1ce4-896c-4f38-8fb4-71fbe7e3fb1b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:46.871132 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8eee1ce4-896c-4f38-8fb4-71fbe7e3fb1b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:46.871835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8eee1ce4-896c-4f38-8fb4-71fbe7e3fb1b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:46.872322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8eee1ce4-896c-4f38-8fb4-71fbe7e3fb1b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:46.872743 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8eee1ce4-896c-4f38-8fb4-71fbe7e3fb1b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:46.906913 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8eee1ce4-896c-4f38-8fb4-71fbe7e3fb1b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049640 Aug 31 11:09:46.908294 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 273/597] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 31 11:09:46 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:09:47.910346 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-68b091dd-89e6-42fe-a145-eb821f24a44a req-7047af3d-24c3-47b8-af39-68f8f0338f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01be6c4-bf01-4970-87ca-7c8e3cf14524", "tag": "a567e33c-5895-4192-99c1-30a51a815ee5"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:47.920644 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-68b091dd-89e6-42fe-a145-eb821f24a44a req-7047af3d-24c3-47b8-af39-68f8f0338f04 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:47.921412 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-68b091dd-89e6-42fe-a145-eb821f24a44a req-7047af3d-24c3-47b8-af39-68f8f0338f04 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:47.922003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-68b091dd-89e6-42fe-a145-eb821f24a44a req-7047af3d-24c3-47b8-af39-68f8f0338f04 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:47.924149 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cff38fb8-1a36-42be-aeb0-449ce46df2b2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:47.929032 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-cff38fb8-1a36-42be-aeb0-449ce46df2b2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:47.934928 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-68b091dd-89e6-42fe-a145-eb821f24a44a req-7047af3d-24c3-47b8-af39-68f8f0338f04 service nova] Creating event network-changed:a567e33c-5895-4192-99c1-30a51a815ee5 for instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 on hv-cinder-85535 Aug 31 11:09:47.938899 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cff38fb8-1a36-42be-aeb0-449ce46df2b2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:47.939589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cff38fb8-1a36-42be-aeb0-449ce46df2b2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:47.940045 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cff38fb8-1a36-42be-aeb0-449ce46df2b2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:47.940770 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cff38fb8-1a36-42be-aeb0-449ce46df2b2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:47.941258 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cff38fb8-1a36-42be-aeb0-449ce46df2b2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:47.941685 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cff38fb8-1a36-42be-aeb0-449ce46df2b2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:47.944111 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-68b091dd-89e6-42fe-a145-eb821f24a44a req-7047af3d-24c3-47b8-af39-68f8f0338f04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038802 Aug 31 11:09:47.945212 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 325/598] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:47.975673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-cff38fb8-1a36-42be-aeb0-449ce46df2b2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057136 Aug 31 11:09:47.976537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 274/599] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 31 11:09:47 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:48.044498 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6ec99c57-8598-4e95-8176-a27071997f1d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:48.044990 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6ec99c57-8598-4e95-8176-a27071997f1d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:48.051412 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6ec99c57-8598-4e95-8176-a27071997f1d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:48.051894 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6ec99c57-8598-4e95-8176-a27071997f1d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:48.052576 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6ec99c57-8598-4e95-8176-a27071997f1d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:48.053273 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6ec99c57-8598-4e95-8176-a27071997f1d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:48.053730 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6ec99c57-8598-4e95-8176-a27071997f1d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:48.054155 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6ec99c57-8598-4e95-8176-a27071997f1d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:48.081171 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6ec99c57-8598-4e95-8176-a27071997f1d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:09:48.184640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6ec99c57-8598-4e95-8176-a27071997f1d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 204 len: 0 microversion: 2.20 time: 0.143917 Aug 31 11:09:48.186092 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 326/600] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 31 11:09:48 2022] DELETE /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 11:09:48.196572 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d5717217-4022-4835-8e9f-61b918a32ea5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:48.197845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d5717217-4022-4835-8e9f-61b918a32ea5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:48.205009 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5717217-4022-4835-8e9f-61b918a32ea5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:48.205528 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5717217-4022-4835-8e9f-61b918a32ea5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:48.205975 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5717217-4022-4835-8e9f-61b918a32ea5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:48.206971 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5717217-4022-4835-8e9f-61b918a32ea5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:48.207433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5717217-4022-4835-8e9f-61b918a32ea5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:48.207918 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5717217-4022-4835-8e9f-61b918a32ea5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:48.357507 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d5717217-4022-4835-8e9f-61b918a32ea5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:48.366445 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d5717217-4022-4835-8e9f-61b918a32ea5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:48.367901 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d5717217-4022-4835-8e9f-61b918a32ea5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:48.369105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d5717217-4022-4835-8e9f-61b918a32ea5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1725 microversion: 2.20 time: 0.177462 Aug 31 11:09:48.369667 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 275/601] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:09:48 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:09:49.393882 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f06261fd-f816-4fe2-a8d9-3c4a997fe125 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:49.394722 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f06261fd-f816-4fe2-a8d9-3c4a997fe125 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:49.400984 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f06261fd-f816-4fe2-a8d9-3c4a997fe125 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:49.401460 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f06261fd-f816-4fe2-a8d9-3c4a997fe125 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:49.401885 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f06261fd-f816-4fe2-a8d9-3c4a997fe125 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:49.402571 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f06261fd-f816-4fe2-a8d9-3c4a997fe125 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:49.403016 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f06261fd-f816-4fe2-a8d9-3c4a997fe125 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:49.403432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f06261fd-f816-4fe2-a8d9-3c4a997fe125 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:49.535710 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f06261fd-f816-4fe2-a8d9-3c4a997fe125 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:49.544230 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f06261fd-f816-4fe2-a8d9-3c4a997fe125 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:49.545682 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f06261fd-f816-4fe2-a8d9-3c4a997fe125 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:49.546848 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f06261fd-f816-4fe2-a8d9-3c4a997fe125 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1725 microversion: 2.20 time: 0.158053 Aug 31 11:09:49.547408 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 327/602] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:09:49 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:09:49.960117 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-10bcfe57-d830-428a-a45b-a4104b9bcd6f req-354f220a-c6d8-42a8-860c-85bf7a15f273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01be6c4-bf01-4970-87ca-7c8e3cf14524", "tag": "a567e33c-5895-4192-99c1-30a51a815ee5"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:49.970188 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-10bcfe57-d830-428a-a45b-a4104b9bcd6f req-354f220a-c6d8-42a8-860c-85bf7a15f273 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:49.970664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-10bcfe57-d830-428a-a45b-a4104b9bcd6f req-354f220a-c6d8-42a8-860c-85bf7a15f273 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:49.971092 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-10bcfe57-d830-428a-a45b-a4104b9bcd6f req-354f220a-c6d8-42a8-860c-85bf7a15f273 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:49.982530 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-10bcfe57-d830-428a-a45b-a4104b9bcd6f req-354f220a-c6d8-42a8-860c-85bf7a15f273 service nova] Creating event network-changed:a567e33c-5895-4192-99c1-30a51a815ee5 for instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 on hv-cinder-85535 Aug 31 11:09:49.987364 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-10bcfe57-d830-428a-a45b-a4104b9bcd6f req-354f220a-c6d8-42a8-860c-85bf7a15f273 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030945 Aug 31 11:09:49.987958 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 276/603] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:50.570650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-815571b9-8ae1-45b7-a2ee-360fce8b8c58 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:50.571429 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-815571b9-8ae1-45b7-a2ee-360fce8b8c58 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:50.578217 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815571b9-8ae1-45b7-a2ee-360fce8b8c58 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:50.578704 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815571b9-8ae1-45b7-a2ee-360fce8b8c58 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:50.579726 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815571b9-8ae1-45b7-a2ee-360fce8b8c58 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:50.580567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815571b9-8ae1-45b7-a2ee-360fce8b8c58 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:50.581027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815571b9-8ae1-45b7-a2ee-360fce8b8c58 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:50.581459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815571b9-8ae1-45b7-a2ee-360fce8b8c58 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:50.730565 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-815571b9-8ae1-45b7-a2ee-360fce8b8c58 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:50.740392 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-815571b9-8ae1-45b7-a2ee-360fce8b8c58 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:50.741856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-815571b9-8ae1-45b7-a2ee-360fce8b8c58 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:50.743075 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-815571b9-8ae1-45b7-a2ee-360fce8b8c58 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1725 microversion: 2.20 time: 0.176383 Aug 31 11:09:50.743643 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 328/604] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:09:50 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:09:51.768000 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:51.768859 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:51.789283 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:51.790461 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:51.791161 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:51.794085 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:51.794801 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:51.795481 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:51.833227 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:51.833719 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:51.834164 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:51.834617 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lazy-loading 'fault' on Instance uuid 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:09:51.883059 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:51.891543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:51.893304 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:51.894924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6e1793ef-4b38-42e3-9e6e-b560c6ff8bd1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 200 len: 1372 microversion: 2.20 time: 0.131939 Aug 31 11:09:51.895290 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 277/605] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:09:51 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 1372 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:09:52.002513 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-44720c54-1649-4a09-970e-3e132dd4f41d req-21c813ca-12dd-4d32-90c6-c53eca14ebe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e", "name": "network-vif-deleted", "tag": "a2414d6d-8b79-405f-a378-ffbb986542cb"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:52.012530 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-44720c54-1649-4a09-970e-3e132dd4f41d req-21c813ca-12dd-4d32-90c6-c53eca14ebe3 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:52.013014 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-44720c54-1649-4a09-970e-3e132dd4f41d req-21c813ca-12dd-4d32-90c6-c53eca14ebe3 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:52.013488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-44720c54-1649-4a09-970e-3e132dd4f41d req-21c813ca-12dd-4d32-90c6-c53eca14ebe3 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:52.027310 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-44720c54-1649-4a09-970e-3e132dd4f41d req-21c813ca-12dd-4d32-90c6-c53eca14ebe3 service nova] Creating event network-vif-deleted:a2414d6d-8b79-405f-a378-ffbb986542cb for instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e on hv-cinder-85535 Aug 31 11:09:52.033464 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-44720c54-1649-4a09-970e-3e132dd4f41d req-21c813ca-12dd-4d32-90c6-c53eca14ebe3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034766 Aug 31 11:09:52.034037 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 329/606] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:52.918573 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1922b724-be2a-400d-8f29-467db0eb0e9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:52.919411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-1922b724-be2a-400d-8f29-467db0eb0e9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:52.925871 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1922b724-be2a-400d-8f29-467db0eb0e9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:52.926344 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1922b724-be2a-400d-8f29-467db0eb0e9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:52.926777 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1922b724-be2a-400d-8f29-467db0eb0e9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:52.927457 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1922b724-be2a-400d-8f29-467db0eb0e9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:52.927911 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1922b724-be2a-400d-8f29-467db0eb0e9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:52.928352 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1922b724-be2a-400d-8f29-467db0eb0e9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:52.941941 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-1922b724-be2a-400d-8f29-467db0eb0e9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] HTTP exception thrown: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1922b724-be2a-400d-8f29-467db0eb0e9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Request method failure captured: Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e HTTP/1.1 Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0CCDoLHRIHvGgX_OnISg4UCwHHo-6LEqKpw3jyj95tS4Jw9832NzJkePB1554MUZYHOXVWCDQrkG5Xi2H7ZcYwuZPX17G9K6AVIPCtUMP8g4PD6xV5xGeOWcGWKi5NARHHidUBX6q2Z_zzj3zAmU2uEkbtAsDODDUpojUv89rH5tJA Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: a25cd48f364541dbaceabdac555bb343 Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:09:52.943562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:09:52.945220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25cd48f364541dbaceabdac555bb343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25cd48f364541dbaceabdac555bb343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25cd48f364541dbaceabdac555bb343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25cd48f364541dbaceabdac555bb343"}]}] Aug 31 11:09:52.945220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:09:52.945220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: a25cd48f364541dbaceabdac555bb343 Aug 31 11:09:52.945220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:09:52.945220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeShelveTestJSON-588349330-project Aug 31 11:09:52.945220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:09:52.945220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:09:52.945220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 714872990c384663bcd564cd5b9ae432 Aug 31 11:09:52.945220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeShelveTestJSON-588349330-project Aug 31 11:09:52.945220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:09:52.945220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:09:52.945220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e'} Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:09:52.946044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:09:52.947200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:09:52.948287 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1922b724-be2a-400d-8f29-467db0eb0e9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Returning 404 to user: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:09:52.948287 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-1922b724-be2a-400d-8f29-467db0eb0e9d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 404 len: 111 microversion: 2.20 time: 0.030293 Aug 31 11:09:52.948287 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 278/607] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:09:52 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:09:52.955258 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-697b2df9-6463-4d6c-9c5d-c59f3f65fa56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '.version_select at 0x7f732d1bbc10>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:52.973676 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-697b2df9-6463-4d6c-9c5d-c59f3f65fa56 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1887607971" status: 204 len: 0 microversion: 2.20 time: 0.023331 Aug 31 11:09:52.974249 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 330/608] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Aug 31 11:09:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1887607971 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 11:09:53.628654 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e4f819fc-183a-4e1c-a4c6-a3a71c8825b5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Action: 'create', calling method: .version_select at 0x7f732d3f5dc0>, body: {"keypair": {"name": "tempest-keypair-196370830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABfG1F6foDqSC4/SVOduXazThstUQlt1dbHfbgppKZvMtVh0t+c7FhyqrCSj9TI1JD19MtBxTYwhwCAiV9UcYcG0BNM7OOvH7CCYp6VRhVoCDQk6WeVn6EA7iPwqJOY/w=="}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:53.643879 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-e4f819fc-183a-4e1c-a4c6-a3a71c8825b5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Getting quotas for project a25cd48f364541dbaceabdac555bb343. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:09:53.647755 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-e4f819fc-183a-4e1c-a4c6-a3a71c8825b5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Getting quotas for user 714872990c384663bcd564cd5b9ae432 and project a25cd48f364541dbaceabdac555bb343. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:09:53.671174 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e4f819fc-183a-4e1c-a4c6-a3a71c8825b5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046487 Aug 31 11:09:53.671764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 279/609] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Aug 31 11:09:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 11:09:54.949342 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1091668050", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81f6ee16-a0fc-484a-ac35-afb225d1c49b"}], "security_groups": [{"name": "tempest-securitygroup--902468346"}], "key_name": "tempest-keypair-196370830", "user_data": "}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:54.958032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:55.056077 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] validate_networks() for [('81f6ee16-a0fc-484a-ac35-afb225d1c49b', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:09:55.425425 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:09:55.425840 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:09:55.426302 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:09:55.426700 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:09:55.427100 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:09:55.435738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:55.436358 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:55.436789 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:55.437532 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:55.438042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:55.438546 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:55.455072 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Getting quotas for project a25cd48f364541dbaceabdac555bb343. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:09:55.458949 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Getting quotas for user 714872990c384663bcd564cd5b9ae432 and project a25cd48f364541dbaceabdac555bb343. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:09:55.470061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:09:55.472431 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:09:55.520103 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-731e519b-58c6-4c47-b910-9c168cc32d06 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.575383 Aug 31 11:09:55.520911 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 331/610] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Aug 31 11:09:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 11:09:55.532839 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-37dbe45a-9205-4aba-b98f-53c3570d5107 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:55.533587 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-37dbe45a-9205-4aba-b98f-53c3570d5107 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:55.588278 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-37dbe45a-9205-4aba-b98f-53c3570d5107 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:55.596302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-37dbe45a-9205-4aba-b98f-53c3570d5107 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:55.597766 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-37dbe45a-9205-4aba-b98f-53c3570d5107 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:55.598905 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-37dbe45a-9205-4aba-b98f-53c3570d5107 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1281 microversion: 2.20 time: 0.071349 Aug 31 11:09:55.599478 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 280/611] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:09:55 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:09:56.620956 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4ccb91f9-1025-4d6f-ad15-1efe7d437e1a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:56.621573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4ccb91f9-1025-4d6f-ad15-1efe7d437e1a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:56.628880 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ccb91f9-1025-4d6f-ad15-1efe7d437e1a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:56.629361 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ccb91f9-1025-4d6f-ad15-1efe7d437e1a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:56.629793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ccb91f9-1025-4d6f-ad15-1efe7d437e1a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:56.630481 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ccb91f9-1025-4d6f-ad15-1efe7d437e1a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:56.630925 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ccb91f9-1025-4d6f-ad15-1efe7d437e1a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:56.631339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ccb91f9-1025-4d6f-ad15-1efe7d437e1a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:56.696668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4ccb91f9-1025-4d6f-ad15-1efe7d437e1a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:56.706160 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4ccb91f9-1025-4d6f-ad15-1efe7d437e1a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:56.707601 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4ccb91f9-1025-4d6f-ad15-1efe7d437e1a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:56.708720 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4ccb91f9-1025-4d6f-ad15-1efe7d437e1a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1333 microversion: 2.20 time: 0.091802 Aug 31 11:09:56.709274 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 332/612] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:09:56 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:09:57.732241 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-aafed4ca-47bb-43b6-9cba-2af9c47d14c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:57.732977 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-aafed4ca-47bb-43b6-9cba-2af9c47d14c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:57.739748 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aafed4ca-47bb-43b6-9cba-2af9c47d14c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:57.740359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aafed4ca-47bb-43b6-9cba-2af9c47d14c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:57.740867 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aafed4ca-47bb-43b6-9cba-2af9c47d14c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:57.741666 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aafed4ca-47bb-43b6-9cba-2af9c47d14c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:57.742187 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aafed4ca-47bb-43b6-9cba-2af9c47d14c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:57.742615 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aafed4ca-47bb-43b6-9cba-2af9c47d14c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:57.937634 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-aafed4ca-47bb-43b6-9cba-2af9c47d14c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:57.947222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-aafed4ca-47bb-43b6-9cba-2af9c47d14c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:57.948701 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-aafed4ca-47bb-43b6-9cba-2af9c47d14c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:57.949820 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-aafed4ca-47bb-43b6-9cba-2af9c47d14c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1406 microversion: 2.20 time: 0.221544 Aug 31 11:09:57.950694 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 281/613] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:09:57 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:09:58.163674 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-96817f85-f872-4989-8dab-b14b7bb97305 req-8c3d7713-1a2b-4c9c-ad43-063d4e68bcc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8572f06c-5fe1-4496-b9e7-92ae0d9b6b84", "tag": "61614d6e-8cbb-415d-9054-acb80c091e6f"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:58.191230 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-96817f85-f872-4989-8dab-b14b7bb97305 req-8c3d7713-1a2b-4c9c-ad43-063d4e68bcc4 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:58.192382 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-96817f85-f872-4989-8dab-b14b7bb97305 req-8c3d7713-1a2b-4c9c-ad43-063d4e68bcc4 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:58.192873 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-96817f85-f872-4989-8dab-b14b7bb97305 req-8c3d7713-1a2b-4c9c-ad43-063d4e68bcc4 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:58.206557 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-96817f85-f872-4989-8dab-b14b7bb97305 req-8c3d7713-1a2b-4c9c-ad43-063d4e68bcc4 service nova] Creating event network-changed:61614d6e-8cbb-415d-9054-acb80c091e6f for instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 on hv-cinder-85535 Aug 31 11:09:58.211659 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-96817f85-f872-4989-8dab-b14b7bb97305 req-8c3d7713-1a2b-4c9c-ad43-063d4e68bcc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055634 Aug 31 11:09:58.212530 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 333/614] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:58.972619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-64a0aa69-0496-4d4d-b23b-ec252a12c28f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:58.973233 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-64a0aa69-0496-4d4d-b23b-ec252a12c28f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:58.979549 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-64a0aa69-0496-4d4d-b23b-ec252a12c28f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:58.980048 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-64a0aa69-0496-4d4d-b23b-ec252a12c28f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:58.980486 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-64a0aa69-0496-4d4d-b23b-ec252a12c28f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:58.981168 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-64a0aa69-0496-4d4d-b23b-ec252a12c28f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:58.981614 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-64a0aa69-0496-4d4d-b23b-ec252a12c28f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:58.982032 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-64a0aa69-0496-4d4d-b23b-ec252a12c28f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:59.108649 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-64a0aa69-0496-4d4d-b23b-ec252a12c28f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:59.117115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-64a0aa69-0496-4d4d-b23b-ec252a12c28f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:59.118544 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-64a0aa69-0496-4d4d-b23b-ec252a12c28f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:59.119662 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-64a0aa69-0496-4d4d-b23b-ec252a12c28f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1406 microversion: 2.20 time: 0.150980 Aug 31 11:09:59.120236 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 282/615] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:09:58 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:10:00.143927 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e9433620-8920-455b-b924-6d094c93e968 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:00.144556 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e9433620-8920-455b-b924-6d094c93e968 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:00.151379 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e9433620-8920-455b-b924-6d094c93e968 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:00.151862 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e9433620-8920-455b-b924-6d094c93e968 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:00.152321 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e9433620-8920-455b-b924-6d094c93e968 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:00.153029 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e9433620-8920-455b-b924-6d094c93e968 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:00.153480 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e9433620-8920-455b-b924-6d094c93e968 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:00.153900 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e9433620-8920-455b-b924-6d094c93e968 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:00.288772 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e9433620-8920-455b-b924-6d094c93e968 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:00.297360 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e9433620-8920-455b-b924-6d094c93e968 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:00.298926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e9433620-8920-455b-b924-6d094c93e968 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:00.300083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e9433620-8920-455b-b924-6d094c93e968 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1406 microversion: 2.20 time: 0.161222 Aug 31 11:10:00.300667 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 334/616] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:10:00 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:10:01.322719 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ef4cff1e-6c01-43a3-8c96-df927dfd0314 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:01.323325 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ef4cff1e-6c01-43a3-8c96-df927dfd0314 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:01.330121 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ef4cff1e-6c01-43a3-8c96-df927dfd0314 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:01.330597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ef4cff1e-6c01-43a3-8c96-df927dfd0314 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:01.331029 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ef4cff1e-6c01-43a3-8c96-df927dfd0314 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:01.331714 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ef4cff1e-6c01-43a3-8c96-df927dfd0314 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:01.332200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ef4cff1e-6c01-43a3-8c96-df927dfd0314 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:01.332622 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ef4cff1e-6c01-43a3-8c96-df927dfd0314 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:01.462198 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ef4cff1e-6c01-43a3-8c96-df927dfd0314 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:01.470910 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ef4cff1e-6c01-43a3-8c96-df927dfd0314 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:01.472382 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ef4cff1e-6c01-43a3-8c96-df927dfd0314 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:01.473485 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ef4cff1e-6c01-43a3-8c96-df927dfd0314 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1406 microversion: 2.20 time: 0.154646 Aug 31 11:10:01.474032 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 283/617] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:10:01 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:10:02.495729 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-841d7e16-761d-42bf-8f3f-3fc007249aaf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:02.496411 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-841d7e16-761d-42bf-8f3f-3fc007249aaf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:02.503022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-841d7e16-761d-42bf-8f3f-3fc007249aaf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:02.503509 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-841d7e16-761d-42bf-8f3f-3fc007249aaf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:02.503969 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-841d7e16-761d-42bf-8f3f-3fc007249aaf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:02.504670 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-841d7e16-761d-42bf-8f3f-3fc007249aaf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:02.505119 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-841d7e16-761d-42bf-8f3f-3fc007249aaf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:02.505541 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-841d7e16-761d-42bf-8f3f-3fc007249aaf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:02.637498 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-841d7e16-761d-42bf-8f3f-3fc007249aaf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:02.645864 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-841d7e16-761d-42bf-8f3f-3fc007249aaf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:02.647308 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-841d7e16-761d-42bf-8f3f-3fc007249aaf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:02.648457 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-841d7e16-761d-42bf-8f3f-3fc007249aaf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1406 microversion: 2.20 time: 0.156545 Aug 31 11:10:02.649050 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 335/618] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:10:02 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:10:03.670682 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7f380f2a-cf81-4b19-a83b-229cc28e55fb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:03.671282 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-7f380f2a-cf81-4b19-a83b-229cc28e55fb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:03.678473 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7f380f2a-cf81-4b19-a83b-229cc28e55fb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:03.678951 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7f380f2a-cf81-4b19-a83b-229cc28e55fb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:03.679383 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7f380f2a-cf81-4b19-a83b-229cc28e55fb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:03.680097 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7f380f2a-cf81-4b19-a83b-229cc28e55fb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:03.680548 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7f380f2a-cf81-4b19-a83b-229cc28e55fb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:03.680968 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7f380f2a-cf81-4b19-a83b-229cc28e55fb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:03.816700 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7f380f2a-cf81-4b19-a83b-229cc28e55fb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:03.824618 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7f380f2a-cf81-4b19-a83b-229cc28e55fb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:03.826052 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7f380f2a-cf81-4b19-a83b-229cc28e55fb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:03.827150 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7f380f2a-cf81-4b19-a83b-229cc28e55fb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1406 microversion: 2.20 time: 0.160385 Aug 31 11:10:03.827707 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 284/619] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:10:03 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:10:04.573630 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-009d5830-8b86-4acf-9513-bdc313211145 req-69201ef1-86b3-4e8a-8fb5-9e7e2e0a22c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8572f06c-5fe1-4496-b9e7-92ae0d9b6b84", "name": "network-vif-plugged", "status": "completed", "tag": "61614d6e-8cbb-415d-9054-acb80c091e6f"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:04.584887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-009d5830-8b86-4acf-9513-bdc313211145 req-69201ef1-86b3-4e8a-8fb5-9e7e2e0a22c9 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:04.585369 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-009d5830-8b86-4acf-9513-bdc313211145 req-69201ef1-86b3-4e8a-8fb5-9e7e2e0a22c9 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:04.586409 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-009d5830-8b86-4acf-9513-bdc313211145 req-69201ef1-86b3-4e8a-8fb5-9e7e2e0a22c9 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:04.598426 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-009d5830-8b86-4acf-9513-bdc313211145 req-69201ef1-86b3-4e8a-8fb5-9e7e2e0a22c9 service nova] Creating event network-vif-plugged:61614d6e-8cbb-415d-9054-acb80c091e6f for instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 on hv-cinder-85535 Aug 31 11:10:04.603303 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-009d5830-8b86-4acf-9513-bdc313211145 req-69201ef1-86b3-4e8a-8fb5-9e7e2e0a22c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033403 Aug 31 11:10:04.604150 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 336/620] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:04.850159 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-956393b2-b7bd-42d8-ab47-b27ab2d9e143 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:04.850831 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-956393b2-b7bd-42d8-ab47-b27ab2d9e143 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:04.853376 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:04.858778 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-956393b2-b7bd-42d8-ab47-b27ab2d9e143 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:04.859261 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-956393b2-b7bd-42d8-ab47-b27ab2d9e143 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:04.859761 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-956393b2-b7bd-42d8-ab47-b27ab2d9e143 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:04.860457 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-956393b2-b7bd-42d8-ab47-b27ab2d9e143 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:04.861442 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-956393b2-b7bd-42d8-ab47-b27ab2d9e143 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:04.861899 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-956393b2-b7bd-42d8-ab47-b27ab2d9e143 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:04.996202 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-956393b2-b7bd-42d8-ab47-b27ab2d9e143 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:05.004274 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-956393b2-b7bd-42d8-ab47-b27ab2d9e143 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:05.005717 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-956393b2-b7bd-42d8-ab47-b27ab2d9e143 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:05.006802 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-956393b2-b7bd-42d8-ab47-b27ab2d9e143 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1406 microversion: 2.20 time: 0.160575 Aug 31 11:10:05.007355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 285/621] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:10:04 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:10:06.030527 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-314c60f0-b3fe-4085-b275-325e6dd28fd0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:06.031266 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-314c60f0-b3fe-4085-b275-325e6dd28fd0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:06.033253 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:06.034112 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=6 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:06.040693 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-314c60f0-b3fe-4085-b275-325e6dd28fd0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:06.041167 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-314c60f0-b3fe-4085-b275-325e6dd28fd0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:06.041596 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-314c60f0-b3fe-4085-b275-325e6dd28fd0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:06.042294 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-314c60f0-b3fe-4085-b275-325e6dd28fd0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:06.042727 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-314c60f0-b3fe-4085-b275-325e6dd28fd0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:06.043140 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-314c60f0-b3fe-4085-b275-325e6dd28fd0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:06.175747 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-314c60f0-b3fe-4085-b275-325e6dd28fd0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:06.183960 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-314c60f0-b3fe-4085-b275-325e6dd28fd0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:06.185429 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-314c60f0-b3fe-4085-b275-325e6dd28fd0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:06.186572 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-314c60f0-b3fe-4085-b275-325e6dd28fd0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1406 microversion: 2.20 time: 0.160307 Aug 31 11:10:06.187401 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 337/622] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:10:06 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:10:07.211425 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-bdfa7c96-172b-4b8f-a828-18ab98746dc0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:07.212141 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-bdfa7c96-172b-4b8f-a828-18ab98746dc0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:07.213874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=6 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:07.219359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-bdfa7c96-172b-4b8f-a828-18ab98746dc0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:07.219826 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-bdfa7c96-172b-4b8f-a828-18ab98746dc0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:07.220371 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-bdfa7c96-172b-4b8f-a828-18ab98746dc0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:07.220976 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-bdfa7c96-172b-4b8f-a828-18ab98746dc0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:07.221420 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-bdfa7c96-172b-4b8f-a828-18ab98746dc0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:07.221835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-bdfa7c96-172b-4b8f-a828-18ab98746dc0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:07.225800 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:07.353081 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-bdfa7c96-172b-4b8f-a828-18ab98746dc0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:07.362018 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-bdfa7c96-172b-4b8f-a828-18ab98746dc0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:07.363463 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-bdfa7c96-172b-4b8f-a828-18ab98746dc0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:07.364636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-bdfa7c96-172b-4b8f-a828-18ab98746dc0 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1598 microversion: 2.20 time: 0.157110 Aug 31 11:10:07.365189 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 286/623] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:10:07 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:10:07.386831 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4b4d41ef-803b-40a7-9704-6ef8a4aa210a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:07.387338 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4b4d41ef-803b-40a7-9704-6ef8a4aa210a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:07.394022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4b4d41ef-803b-40a7-9704-6ef8a4aa210a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:07.394513 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4b4d41ef-803b-40a7-9704-6ef8a4aa210a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:07.394926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4b4d41ef-803b-40a7-9704-6ef8a4aa210a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:07.395613 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4b4d41ef-803b-40a7-9704-6ef8a4aa210a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:07.396079 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4b4d41ef-803b-40a7-9704-6ef8a4aa210a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:07.396497 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4b4d41ef-803b-40a7-9704-6ef8a4aa210a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:07.480295 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4b4d41ef-803b-40a7-9704-6ef8a4aa210a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097211 Aug 31 11:10:07.480890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 338/624] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Aug 31 11:10:07 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:10:08.600135 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-8517ff84-90a8-4706-b720-4682ca016e93 req-18bf46ff-713a-44d0-a4b2-62acec091986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8572f06c-5fe1-4496-b9e7-92ae0d9b6b84", "tag": "61614d6e-8cbb-415d-9054-acb80c091e6f"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:08.609770 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-8517ff84-90a8-4706-b720-4682ca016e93 req-18bf46ff-713a-44d0-a4b2-62acec091986 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:08.610235 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-8517ff84-90a8-4706-b720-4682ca016e93 req-18bf46ff-713a-44d0-a4b2-62acec091986 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:08.610747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-8517ff84-90a8-4706-b720-4682ca016e93 req-18bf46ff-713a-44d0-a4b2-62acec091986 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:08.622332 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-8517ff84-90a8-4706-b720-4682ca016e93 req-18bf46ff-713a-44d0-a4b2-62acec091986 service nova] Creating event network-changed:61614d6e-8cbb-415d-9054-acb80c091e6f for instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 on hv-cinder-85535 Aug 31 11:10:08.627822 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-8517ff84-90a8-4706-b720-4682ca016e93 req-18bf46ff-713a-44d0-a4b2-62acec091986 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032351 Aug 31 11:10:08.628896 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 287/625] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:16.473067 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0be12c19-ab87-4926-aa1a-9bfacbf6c5aa tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:16.473684 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-0be12c19-ab87-4926-aa1a-9bfacbf6c5aa tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:16.479388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0be12c19-ab87-4926-aa1a-9bfacbf6c5aa tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:16.479859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0be12c19-ab87-4926-aa1a-9bfacbf6c5aa tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:16.480317 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0be12c19-ab87-4926-aa1a-9bfacbf6c5aa tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:16.481011 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0be12c19-ab87-4926-aa1a-9bfacbf6c5aa tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:16.481440 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0be12c19-ab87-4926-aa1a-9bfacbf6c5aa tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:16.481857 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0be12c19-ab87-4926-aa1a-9bfacbf6c5aa tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:16.484346 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:16.728507 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-0be12c19-ab87-4926-aa1a-9bfacbf6c5aa tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lazy-loading 'services' on Instance uuid b50ff8cd-8095-43f9-9b25-30536f129ac3 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:16.802753 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0be12c19-ab87-4926-aa1a-9bfacbf6c5aa tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/os-volume_attachments/380d061b-e819-495b-b58b-36abed3556bd" status: 202 len: 0 microversion: 2.1 time: 0.334764 Aug 31 11:10:16.803576 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 339/626] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 11:10:16 2022] DELETE /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/os-volume_attachments/380d061b-e819-495b-b58b-36abed3556bd => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:10:17.389435 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-2d5a6e6e-1db1-4931-bcb6-6c78cc68e573 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:17.390061 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-2d5a6e6e-1db1-4931-bcb6-6c78cc68e573 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:17.397218 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2d5a6e6e-1db1-4931-bcb6-6c78cc68e573 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:17.397699 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2d5a6e6e-1db1-4931-bcb6-6c78cc68e573 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:17.398148 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2d5a6e6e-1db1-4931-bcb6-6c78cc68e573 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:17.398828 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2d5a6e6e-1db1-4931-bcb6-6c78cc68e573 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:17.399273 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2d5a6e6e-1db1-4931-bcb6-6c78cc68e573 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:17.399700 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2d5a6e6e-1db1-4931-bcb6-6c78cc68e573 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:17.424760 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-2d5a6e6e-1db1-4931-bcb6-6c78cc68e573 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/ips" status: 200 len: 148 microversion: 2.1 time: 0.038882 Aug 31 11:10:17.425325 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 288/627] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 11:10:17 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:18.759843 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0dfa9545-3b25-45fb-9c34-86fa3d53076a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ce78ba5-edd6-4850-92f1-bb089198310c"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:18.762319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-0dfa9545-3b25-45fb-9c34-86fa3d53076a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:18.769165 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0dfa9545-3b25-45fb-9c34-86fa3d53076a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:18.769643 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0dfa9545-3b25-45fb-9c34-86fa3d53076a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:18.770077 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0dfa9545-3b25-45fb-9c34-86fa3d53076a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:18.770766 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0dfa9545-3b25-45fb-9c34-86fa3d53076a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:18.771221 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0dfa9545-3b25-45fb-9c34-86fa3d53076a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:18.771641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0dfa9545-3b25-45fb-9c34-86fa3d53076a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:18.993213 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3f3828ee-a50f-4485-ad7f-d91d93846077 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:19.001121 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f3828ee-a50f-4485-ad7f-d91d93846077 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:19.002400 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f3828ee-a50f-4485-ad7f-d91d93846077 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:19.003330 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f3828ee-a50f-4485-ad7f-d91d93846077 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:19.027383 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3f3828ee-a50f-4485-ad7f-d91d93846077 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Going to try to stop instance {{(pid=120655) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 11:10:19.029809 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0dfa9545-3b25-45fb-9c34-86fa3d53076a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274262 Aug 31 11:10:19.030425 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 340/628] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:10:18 2022] POST /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:19.074438 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3f3828ee-a50f-4485-ad7f-d91d93846077 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "POST /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/action" status: 202 len: 0 microversion: 2.1 time: 0.084927 Aug 31 11:10:19.076051 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 289/629] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:10:18 2022] POST /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:10:19.084755 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-bc0e45f4-d512-4a04-89f2-f7a1369709e8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:19.085427 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-bc0e45f4-d512-4a04-89f2-f7a1369709e8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:19.093268 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc0e45f4-d512-4a04-89f2-f7a1369709e8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:19.093756 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc0e45f4-d512-4a04-89f2-f7a1369709e8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:19.094186 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc0e45f4-d512-4a04-89f2-f7a1369709e8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:19.095081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc0e45f4-d512-4a04-89f2-f7a1369709e8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:19.095557 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc0e45f4-d512-4a04-89f2-f7a1369709e8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:19.095978 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc0e45f4-d512-4a04-89f2-f7a1369709e8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:19.234373 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-bc0e45f4-d512-4a04-89f2-f7a1369709e8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:19.242523 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-bc0e45f4-d512-4a04-89f2-f7a1369709e8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1679 microversion: 2.1 time: 0.162926 Aug 31 11:10:19.243095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 341/630] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:19 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:20.265579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e3de2174-8ad0-4a37-b51a-ff74ba908e65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:20.266299 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e3de2174-8ad0-4a37-b51a-ff74ba908e65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:20.273239 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3de2174-8ad0-4a37-b51a-ff74ba908e65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:20.273727 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3de2174-8ad0-4a37-b51a-ff74ba908e65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:20.274161 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3de2174-8ad0-4a37-b51a-ff74ba908e65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:20.274861 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3de2174-8ad0-4a37-b51a-ff74ba908e65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:20.275310 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3de2174-8ad0-4a37-b51a-ff74ba908e65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:20.275733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3de2174-8ad0-4a37-b51a-ff74ba908e65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:20.462910 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e3de2174-8ad0-4a37-b51a-ff74ba908e65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:20.472143 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e3de2174-8ad0-4a37-b51a-ff74ba908e65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1679 microversion: 2.1 time: 0.211449 Aug 31 11:10:20.472712 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 290/631] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:20 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:20.499168 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e0ce7418-0d73-4df8-9a49-fe7824ef5640 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1001164686"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:20.499772 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e0ce7418-0d73-4df8-9a49-fe7824ef5640 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:20.506930 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0ce7418-0d73-4df8-9a49-fe7824ef5640 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:20.507409 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0ce7418-0d73-4df8-9a49-fe7824ef5640 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:20.507841 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0ce7418-0d73-4df8-9a49-fe7824ef5640 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:20.508563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0ce7418-0d73-4df8-9a49-fe7824ef5640 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:20.509016 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0ce7418-0d73-4df8-9a49-fe7824ef5640 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:20.509436 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0ce7418-0d73-4df8-9a49-fe7824ef5640 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:20.633593 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.network.security_group_api [None req-e0ce7418-0d73-4df8-9a49-fe7824ef5640 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Removing security group 84a53094-9dcd-4cc6-b8d1-2bfe89a4c57d from port 7b6fd60a-b00d-41c8-912f-b319241ebfad Aug 31 11:10:20.952208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e0ce7418-0d73-4df8-9a49-fe7824ef5640 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "POST /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/action" status: 202 len: 0 microversion: 2.1 time: 0.456817 Aug 31 11:10:20.953027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 342/632] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:10:20 2022] POST /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:10:20.962509 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-5a12cd7f-e32d-4683-9b31-bba557785bbf req-9423e985-1784-432c-aace-0e112c4564de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ab2526-7363-4846-86d8-cb2fa6705c76", "tag": "7b6fd60a-b00d-41c8-912f-b319241ebfad"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:20.973394 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5a12cd7f-e32d-4683-9b31-bba557785bbf req-9423e985-1784-432c-aace-0e112c4564de service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:20.974207 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5a12cd7f-e32d-4683-9b31-bba557785bbf req-9423e985-1784-432c-aace-0e112c4564de service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:20.974862 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5a12cd7f-e32d-4683-9b31-bba557785bbf req-9423e985-1784-432c-aace-0e112c4564de service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:20.989740 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-5a12cd7f-e32d-4683-9b31-bba557785bbf req-9423e985-1784-432c-aace-0e112c4564de service nova] Creating event network-changed:7b6fd60a-b00d-41c8-912f-b319241ebfad for instance f1ab2526-7363-4846-86d8-cb2fa6705c76 on hv-cinder-85535 Aug 31 11:10:20.996288 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-5a12cd7f-e32d-4683-9b31-bba557785bbf req-9423e985-1784-432c-aace-0e112c4564de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037830 Aug 31 11:10:20.997541 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 291/633] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:21.495818 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4d0d801e-b8b4-4119-ac21-b99aa83789bd tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:21.496480 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4d0d801e-b8b4-4119-ac21-b99aa83789bd tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:21.504244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4d0d801e-b8b4-4119-ac21-b99aa83789bd tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:21.505766 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4d0d801e-b8b4-4119-ac21-b99aa83789bd tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:21.506694 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4d0d801e-b8b4-4119-ac21-b99aa83789bd tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:21.508902 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4d0d801e-b8b4-4119-ac21-b99aa83789bd tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:21.509539 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4d0d801e-b8b4-4119-ac21-b99aa83789bd tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:21.510131 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4d0d801e-b8b4-4119-ac21-b99aa83789bd tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:21.705875 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4d0d801e-b8b4-4119-ac21-b99aa83789bd tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:21.714306 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4d0d801e-b8b4-4119-ac21-b99aa83789bd tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1679 microversion: 2.1 time: 0.224216 Aug 31 11:10:21.715025 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 343/634] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:21 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:22.402210 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6be0c93a-5f45-4d1b-a1ed-1497fa7b2f32 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:22.402797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6be0c93a-5f45-4d1b-a1ed-1497fa7b2f32 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:22.409284 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6be0c93a-5f45-4d1b-a1ed-1497fa7b2f32 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:22.409766 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6be0c93a-5f45-4d1b-a1ed-1497fa7b2f32 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:22.410200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6be0c93a-5f45-4d1b-a1ed-1497fa7b2f32 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:22.410896 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6be0c93a-5f45-4d1b-a1ed-1497fa7b2f32 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:22.411345 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6be0c93a-5f45-4d1b-a1ed-1497fa7b2f32 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:22.411765 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6be0c93a-5f45-4d1b-a1ed-1497fa7b2f32 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:22.495151 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-6be0c93a-5f45-4d1b-a1ed-1497fa7b2f32 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lazy-loading 'services' on Instance uuid f1ab2526-7363-4846-86d8-cb2fa6705c76 {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:22.567806 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6be0c93a-5f45-4d1b-a1ed-1497fa7b2f32 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments/4cd4b966-83c1-4411-96f8-f87bc34fc543" status: 202 len: 0 microversion: 2.1 time: 0.170228 Aug 31 11:10:22.568518 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 292/635] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 11:10:22 2022] DELETE /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments/4cd4b966-83c1-4411-96f8-f87bc34fc543 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:10:22.578016 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3d47db1a-6a5d-4ec8-9023-7293d8f60b24 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:22.580859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3d47db1a-6a5d-4ec8-9023-7293d8f60b24 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:22.587565 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3d47db1a-6a5d-4ec8-9023-7293d8f60b24 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:22.588086 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3d47db1a-6a5d-4ec8-9023-7293d8f60b24 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:22.588570 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3d47db1a-6a5d-4ec8-9023-7293d8f60b24 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:22.589272 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3d47db1a-6a5d-4ec8-9023-7293d8f60b24 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:22.589802 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3d47db1a-6a5d-4ec8-9023-7293d8f60b24 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:22.590307 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3d47db1a-6a5d-4ec8-9023-7293d8f60b24 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:22.621591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3d47db1a-6a5d-4ec8-9023-7293d8f60b24 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047653 Aug 31 11:10:22.622156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 344/636] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:10:22 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:22.737996 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-da7ae5c5-f531-4922-bdd7-45b948b4f2f7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:22.738711 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-da7ae5c5-f531-4922-bdd7-45b948b4f2f7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:22.745157 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da7ae5c5-f531-4922-bdd7-45b948b4f2f7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:22.745637 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da7ae5c5-f531-4922-bdd7-45b948b4f2f7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:22.746072 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da7ae5c5-f531-4922-bdd7-45b948b4f2f7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:22.746774 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da7ae5c5-f531-4922-bdd7-45b948b4f2f7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:22.747232 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da7ae5c5-f531-4922-bdd7-45b948b4f2f7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:22.747655 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da7ae5c5-f531-4922-bdd7-45b948b4f2f7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:22.887563 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-da7ae5c5-f531-4922-bdd7-45b948b4f2f7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:22.895643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-da7ae5c5-f531-4922-bdd7-45b948b4f2f7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1679 microversion: 2.1 time: 0.162069 Aug 31 11:10:22.908628 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 293/637] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:22 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:23.019705 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-8ece5cdc-c861-4688-9620-4defa592311c req-037f8724-1558-44f7-8ace-0f411c20722a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ab2526-7363-4846-86d8-cb2fa6705c76", "tag": "7b6fd60a-b00d-41c8-912f-b319241ebfad"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:23.028711 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-8ece5cdc-c861-4688-9620-4defa592311c req-037f8724-1558-44f7-8ace-0f411c20722a service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:23.029182 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-8ece5cdc-c861-4688-9620-4defa592311c req-037f8724-1558-44f7-8ace-0f411c20722a service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:23.029603 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-8ece5cdc-c861-4688-9620-4defa592311c req-037f8724-1558-44f7-8ace-0f411c20722a service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:23.041777 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-8ece5cdc-c861-4688-9620-4defa592311c req-037f8724-1558-44f7-8ace-0f411c20722a service nova] Creating event network-changed:7b6fd60a-b00d-41c8-912f-b319241ebfad for instance f1ab2526-7363-4846-86d8-cb2fa6705c76 on hv-cinder-85535 Aug 31 11:10:23.046639 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-8ece5cdc-c861-4688-9620-4defa592311c req-037f8724-1558-44f7-8ace-0f411c20722a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031138 Aug 31 11:10:23.047235 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 345/638] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:10:23.634089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ddeb5683-abfb-4725-be86-fd5f1321b8a6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:23.636422 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ddeb5683-abfb-4725-be86-fd5f1321b8a6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:23.643616 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ddeb5683-abfb-4725-be86-fd5f1321b8a6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:23.644125 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ddeb5683-abfb-4725-be86-fd5f1321b8a6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:23.644560 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ddeb5683-abfb-4725-be86-fd5f1321b8a6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:23.645253 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ddeb5683-abfb-4725-be86-fd5f1321b8a6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:23.645704 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ddeb5683-abfb-4725-be86-fd5f1321b8a6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:23.646127 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ddeb5683-abfb-4725-be86-fd5f1321b8a6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:23.675610 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ddeb5683-abfb-4725-be86-fd5f1321b8a6 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045417 Aug 31 11:10:23.676192 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 294/639] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:10:23 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:23.919074 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-503b6793-a4eb-4ac1-a9a3-144572e63b75 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:23.919780 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-503b6793-a4eb-4ac1-a9a3-144572e63b75 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:23.926531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-503b6793-a4eb-4ac1-a9a3-144572e63b75 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:23.927012 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-503b6793-a4eb-4ac1-a9a3-144572e63b75 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:23.927438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-503b6793-a4eb-4ac1-a9a3-144572e63b75 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:23.928155 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-503b6793-a4eb-4ac1-a9a3-144572e63b75 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:23.928610 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-503b6793-a4eb-4ac1-a9a3-144572e63b75 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:23.929030 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-503b6793-a4eb-4ac1-a9a3-144572e63b75 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:24.057529 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-503b6793-a4eb-4ac1-a9a3-144572e63b75 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:24.065841 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-503b6793-a4eb-4ac1-a9a3-144572e63b75 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1679 microversion: 2.1 time: 0.151433 Aug 31 11:10:24.066401 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 346/640] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:23 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:24.688137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b12f95d4-85fe-481a-b613-830fff69734f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:24.690638 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b12f95d4-85fe-481a-b613-830fff69734f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:24.697500 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b12f95d4-85fe-481a-b613-830fff69734f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:24.697981 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b12f95d4-85fe-481a-b613-830fff69734f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:24.698408 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b12f95d4-85fe-481a-b613-830fff69734f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:24.699124 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b12f95d4-85fe-481a-b613-830fff69734f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:24.699565 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b12f95d4-85fe-481a-b613-830fff69734f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:24.699982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b12f95d4-85fe-481a-b613-830fff69734f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:24.730234 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b12f95d4-85fe-481a-b613-830fff69734f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046051 Aug 31 11:10:24.730786 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 295/641] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:10:24 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:25.087025 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-53d09f8d-ddca-40be-a0c7-0e59ae3c31b1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:25.087593 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-53d09f8d-ddca-40be-a0c7-0e59ae3c31b1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:25.089964 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:25.094895 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53d09f8d-ddca-40be-a0c7-0e59ae3c31b1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:25.095410 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53d09f8d-ddca-40be-a0c7-0e59ae3c31b1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:25.095838 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53d09f8d-ddca-40be-a0c7-0e59ae3c31b1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:25.096549 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53d09f8d-ddca-40be-a0c7-0e59ae3c31b1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:25.096999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53d09f8d-ddca-40be-a0c7-0e59ae3c31b1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:25.097419 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-53d09f8d-ddca-40be-a0c7-0e59ae3c31b1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:25.229120 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-53d09f8d-ddca-40be-a0c7-0e59ae3c31b1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:25.237362 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-53d09f8d-ddca-40be-a0c7-0e59ae3c31b1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1679 microversion: 2.1 time: 0.154347 Aug 31 11:10:25.237915 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 347/642] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:25 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:25.743315 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e37a47f0-e076-4937-b7c1-44243ca0ab38 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:25.745460 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e37a47f0-e076-4937-b7c1-44243ca0ab38 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:25.753573 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e37a47f0-e076-4937-b7c1-44243ca0ab38 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:25.754230 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e37a47f0-e076-4937-b7c1-44243ca0ab38 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:25.754856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e37a47f0-e076-4937-b7c1-44243ca0ab38 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:25.755833 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e37a47f0-e076-4937-b7c1-44243ca0ab38 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:25.756322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e37a47f0-e076-4937-b7c1-44243ca0ab38 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:25.756821 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e37a47f0-e076-4937-b7c1-44243ca0ab38 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:25.788653 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e37a47f0-e076-4937-b7c1-44243ca0ab38 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049245 Aug 31 11:10:25.789230 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 296/643] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:10:25 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:26.258358 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4bd33367-0c5f-44c0-bafc-97def88e4484 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:26.258962 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4bd33367-0c5f-44c0-bafc-97def88e4484 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:26.265709 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4bd33367-0c5f-44c0-bafc-97def88e4484 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:26.266192 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4bd33367-0c5f-44c0-bafc-97def88e4484 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:26.266622 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4bd33367-0c5f-44c0-bafc-97def88e4484 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:26.267851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4bd33367-0c5f-44c0-bafc-97def88e4484 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:26.268583 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4bd33367-0c5f-44c0-bafc-97def88e4484 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:26.269010 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4bd33367-0c5f-44c0-bafc-97def88e4484 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:26.398936 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4bd33367-0c5f-44c0-bafc-97def88e4484 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:26.406919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4bd33367-0c5f-44c0-bafc-97def88e4484 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1679 microversion: 2.1 time: 0.152556 Aug 31 11:10:26.407497 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 348/644] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:26 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:26.634790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1c9e0f46-c88b-4ec8-ab2b-4b0b4ce604f8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ce78ba5-edd6-4850-92f1-bb089198310c"}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:26.637077 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-1c9e0f46-c88b-4ec8-ab2b-4b0b4ce604f8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:26.643083 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1c9e0f46-c88b-4ec8-ab2b-4b0b4ce604f8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:26.643559 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1c9e0f46-c88b-4ec8-ab2b-4b0b4ce604f8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:26.643995 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1c9e0f46-c88b-4ec8-ab2b-4b0b4ce604f8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:26.644736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1c9e0f46-c88b-4ec8-ab2b-4b0b4ce604f8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:26.645190 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1c9e0f46-c88b-4ec8-ab2b-4b0b4ce604f8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:26.645611 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1c9e0f46-c88b-4ec8-ab2b-4b0b4ce604f8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:26.729480 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-1c9e0f46-c88b-4ec8-ab2b-4b0b4ce604f8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Invalid volume: volume 2ce78ba5-edd6-4850-92f1-bb089198310c is already attached to instances: 2f70e795-e50c-414e-b302-2b818ce84337 Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1c9e0f46-c88b-4ec8-ab2b-4b0b4ce604f8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: POST /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-volume_attachments HTTP/1.1 Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 74 Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:10:26.731436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:10:26.733126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:10:26.733126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:10:26.733126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:10:26.733126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:10:26.733126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:10:26.733126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:10:26.733126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:10:26.733126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:10:26.733126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:10:26.733126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Aug 31 11:10:26.733126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {"volumeAttachment": {"volumeId": "2ce78ba5-edd6-4850-92f1-bb089198310c"}} Aug 31 11:10:26.733126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Invalid volume: volume 2ce78ba5-edd6-4850-92f1-bb089198310c is already attached to instances: 2f70e795-e50c-414e-b302-2b818ce84337 Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'server_id': '2f70e795-e50c-414e-b302-2b818ce84337', 'body': {'volumeAttachment': {'volumeId': '2ce78ba5-edd6-4850-92f1-bb089198310c'}}} Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2ce78ba5-edd6-4850-92f1-bb089198310c is already attached to instances: 2f70e795-e50c-414e-b302-2b818ce84337 Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:26.734040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2ce78ba5-edd6-4850-92f1-bb089198310c is already attached to instances: 2f70e795-e50c-414e-b302-2b818ce84337 Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:26.735454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:26.738245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:26.738245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:10:26.738245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:10:26.738245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2ce78ba5-edd6-4850-92f1-bb089198310c is already attached to instances: 2f70e795-e50c-414e-b302-2b818ce84337 Aug 31 11:10:26.738245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:26.738245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1c9e0f46-c88b-4ec8-ab2b-4b0b4ce604f8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 400 to user: Invalid volume: volume 2ce78ba5-edd6-4850-92f1-bb089198310c is already attached to instances: 2f70e795-e50c-414e-b302-2b818ce84337 {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:10:26.738245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-1c9e0f46-c88b-4ec8-ab2b-4b0b4ce604f8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102027 Aug 31 11:10:26.738245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 297/645] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:10:26 2022] POST /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:10:26.800697 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5eb248fe-d825-4451-8bbb-eeded44fa832 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:26.801317 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5eb248fe-d825-4451-8bbb-eeded44fa832 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:26.802513 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e6006412-338e-48ef-b40a-7df261f1b476 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:26.804843 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e6006412-338e-48ef-b40a-7df261f1b476 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:26.807459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5eb248fe-d825-4451-8bbb-eeded44fa832 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:26.807940 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5eb248fe-d825-4451-8bbb-eeded44fa832 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:26.808403 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5eb248fe-d825-4451-8bbb-eeded44fa832 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:26.809097 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5eb248fe-d825-4451-8bbb-eeded44fa832 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:26.809548 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5eb248fe-d825-4451-8bbb-eeded44fa832 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:26.809968 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5eb248fe-d825-4451-8bbb-eeded44fa832 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:26.812115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e6006412-338e-48ef-b40a-7df261f1b476 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:26.812791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e6006412-338e-48ef-b40a-7df261f1b476 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:26.813263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e6006412-338e-48ef-b40a-7df261f1b476 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:26.813986 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e6006412-338e-48ef-b40a-7df261f1b476 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:26.814433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e6006412-338e-48ef-b40a-7df261f1b476 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:26.814858 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e6006412-338e-48ef-b40a-7df261f1b476 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:26.847865 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e6006412-338e-48ef-b40a-7df261f1b476 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049309 Aug 31 11:10:26.848471 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 298/646] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:10:26 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 11:10:26.858658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-989916a0-1eab-435e-9133-2cd560c427e7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:26.859237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-989916a0-1eab-435e-9133-2cd560c427e7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:26.866636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-989916a0-1eab-435e-9133-2cd560c427e7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:26.866636 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-989916a0-1eab-435e-9133-2cd560c427e7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:26.867001 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-989916a0-1eab-435e-9133-2cd560c427e7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:26.867692 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-989916a0-1eab-435e-9133-2cd560c427e7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:26.868175 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-989916a0-1eab-435e-9133-2cd560c427e7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:26.868593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-989916a0-1eab-435e-9133-2cd560c427e7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:26.895666 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-5eb248fe-d825-4451-8bbb-eeded44fa832 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lazy-loading 'services' on Instance uuid 2f70e795-e50c-414e-b302-2b818ce84337 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:26.948531 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-989916a0-1eab-435e-9133-2cd560c427e7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] HTTP exception thrown: Instance f1ab2526-7363-4846-86d8-cb2fa6705c76 is not attached to volume 4cd4b966-83c1-4411-96f8-f87bc34fc543 Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-989916a0-1eab-435e-9133-2cd560c427e7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Request method failure captured: Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: DELETE /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments/4cd4b966-83c1-4411-96f8-f87bc34fc543 HTTP/1.1 Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0DBEewiVWl9LIOWwD3b_0LV5k3vbSv_AGspWhvgzNUfKvUkmb5wD-3AgfazBMcLLeqHScqssDtkQu68h5Gozclvv3WzGWkKK-JzhDVJWkpedjsChzVxsTgEkb2ufzrfRXa6ngaKtVAhgvxMLvTy1vW9t8W6PYfCt66CfGZeIxmleVE Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 6e4af9139d2b47cf8ea8646c5a4f4a9f Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-TestMinimumBasicScenario-543014898 Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:10:26.957237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:10:26.958790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e4af9139d2b47cf8ea8646c5a4f4a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e4af9139d2b47cf8ea8646c5a4f4a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e4af9139d2b47cf8ea8646c5a4f4a9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e4af9139d2b47cf8ea8646c5a4f4a9f"}]}] Aug 31 11:10:26.958790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-TestMinimumBasicScenario-543014898 Aug 31 11:10:26.958790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 6e4af9139d2b47cf8ea8646c5a4f4a9f Aug 31 11:10:26.958790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-TestMinimumBasicScenario-543014898 Aug 31 11:10:26.958790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-TestMinimumBasicScenario-543014898-project Aug 31 11:10:26.958790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:10:26.958790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:10:26.958790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 74fa7242b82941cc9ef9f21f122b1e4c Aug 31 11:10:26.958790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-TestMinimumBasicScenario-543014898-project Aug 31 11:10:26.958790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:10:26.958790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance f1ab2526-7363-4846-86d8-cb2fa6705c76 is not attached to volume 4cd4b966-83c1-4411-96f8-f87bc34fc543 Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'server_id': 'f1ab2526-7363-4846-86d8-cb2fa6705c76', 'id': '4cd4b966-83c1-4411-96f8-f87bc34fc543'} Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4cd4b966-83c1-4411-96f8-f87bc34fc543. Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:10:26.959558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ab2526-7363-4846-86d8-cb2fa6705c76 is not attached to volume 4cd4b966-83c1-4411-96f8-f87bc34fc543 Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ab2526-7363-4846-86d8-cb2fa6705c76 is not attached to volume 4cd4b966-83c1-4411-96f8-f87bc34fc543 Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:26.960708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-989916a0-1eab-435e-9133-2cd560c427e7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Returning 404 to user: Instance f1ab2526-7363-4846-86d8-cb2fa6705c76 is not attached to volume 4cd4b966-83c1-4411-96f8-f87bc34fc543 {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:10:26.961601 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-989916a0-1eab-435e-9133-2cd560c427e7 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments/4cd4b966-83c1-4411-96f8-f87bc34fc543" status: 404 len: 154 microversion: 2.1 time: 0.105050 Aug 31 11:10:26.961601 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 299/647] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 11:10:26 2022] DELETE /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76/os-volume_attachments/4cd4b966-83c1-4411-96f8-f87bc34fc543 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:10:26.970340 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-5eb248fe-d825-4451-8bbb-eeded44fa832 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-volume_attachments/2ce78ba5-edd6-4850-92f1-bb089198310c" status: 202 len: 0 microversion: 2.1 time: 0.173499 Aug 31 11:10:26.971212 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 349/648] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 11:10:26 2022] DELETE /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-volume_attachments/2ce78ba5-edd6-4850-92f1-bb089198310c => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:10:26.979235 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6eedbff0-eb7a-48b3-864c-31a210af786c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:26.981617 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6eedbff0-eb7a-48b3-864c-31a210af786c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:26.991675 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6eedbff0-eb7a-48b3-864c-31a210af786c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:26.992201 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6eedbff0-eb7a-48b3-864c-31a210af786c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:26.992773 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6eedbff0-eb7a-48b3-864c-31a210af786c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:26.993619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6eedbff0-eb7a-48b3-864c-31a210af786c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:26.994094 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6eedbff0-eb7a-48b3-864c-31a210af786c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:26.994623 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6eedbff0-eb7a-48b3-864c-31a210af786c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:27.030924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6eedbff0-eb7a-48b3-864c-31a210af786c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055586 Aug 31 11:10:27.031687 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 300/649] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:10:26 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:27.430347 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8ba1e501-b9b7-47ec-b252-4e71e5c27743 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:27.431022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8ba1e501-b9b7-47ec-b252-4e71e5c27743 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:27.437363 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ba1e501-b9b7-47ec-b252-4e71e5c27743 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:27.437754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ba1e501-b9b7-47ec-b252-4e71e5c27743 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:27.438178 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ba1e501-b9b7-47ec-b252-4e71e5c27743 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:27.438861 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ba1e501-b9b7-47ec-b252-4e71e5c27743 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:27.439301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ba1e501-b9b7-47ec-b252-4e71e5c27743 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:27.439718 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8ba1e501-b9b7-47ec-b252-4e71e5c27743 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:27.575802 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8ba1e501-b9b7-47ec-b252-4e71e5c27743 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:27.584743 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8ba1e501-b9b7-47ec-b252-4e71e5c27743 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1679 microversion: 2.1 time: 0.158974 Aug 31 11:10:27.585315 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 350/650] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:27 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:28.045444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-93938d74-3514-446c-b586-d6d560493a26 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:28.047985 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-93938d74-3514-446c-b586-d6d560493a26 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:28.056383 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-93938d74-3514-446c-b586-d6d560493a26 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.057187 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-93938d74-3514-446c-b586-d6d560493a26 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.057913 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-93938d74-3514-446c-b586-d6d560493a26 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.059058 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-93938d74-3514-446c-b586-d6d560493a26 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.059794 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-93938d74-3514-446c-b586-d6d560493a26 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.060536 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-93938d74-3514-446c-b586-d6d560493a26 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.098800 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-93938d74-3514-446c-b586-d6d560493a26 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059568 Aug 31 11:10:28.099639 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 301/651] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:10:28 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:10:28.120339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2835332d-7f87-4057-9976-4b7ca80aa332 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:28.121013 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2835332d-7f87-4057-9976-4b7ca80aa332 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:28.129366 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2835332d-7f87-4057-9976-4b7ca80aa332 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.129856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2835332d-7f87-4057-9976-4b7ca80aa332 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.130284 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2835332d-7f87-4057-9976-4b7ca80aa332 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.130986 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2835332d-7f87-4057-9976-4b7ca80aa332 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.131430 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2835332d-7f87-4057-9976-4b7ca80aa332 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.131854 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2835332d-7f87-4057-9976-4b7ca80aa332 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.167461 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2835332d-7f87-4057-9976-4b7ca80aa332 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:10:28.179368 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-eda7fc97-c8ad-49d4-9418-a5861ed30c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:28.180359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-eda7fc97-c8ad-49d4-9418-a5861ed30c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:28.190516 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eda7fc97-c8ad-49d4-9418-a5861ed30c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.191528 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eda7fc97-c8ad-49d4-9418-a5861ed30c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.192189 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eda7fc97-c8ad-49d4-9418-a5861ed30c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.193086 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eda7fc97-c8ad-49d4-9418-a5861ed30c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.193534 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eda7fc97-c8ad-49d4-9418-a5861ed30c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.194200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eda7fc97-c8ad-49d4-9418-a5861ed30c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.223493 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-eda7fc97-c8ad-49d4-9418-a5861ed30c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Going to try to terminate instance {{(pid=120655) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:10:28.226521 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:28.262503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2835332d-7f87-4057-9976-4b7ca80aa332 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 204 len: 0 microversion: 2.1 time: 0.145530 Aug 31 11:10:28.263154 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 351/652] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:10:28 2022] DELETE /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:10:28.273443 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ff80e2d4-69e0-4d85-a26b-18a247f64621 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:28.274756 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ff80e2d4-69e0-4d85-a26b-18a247f64621 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:28.280721 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ff80e2d4-69e0-4d85-a26b-18a247f64621 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.281204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ff80e2d4-69e0-4d85-a26b-18a247f64621 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.281640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ff80e2d4-69e0-4d85-a26b-18a247f64621 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.282697 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ff80e2d4-69e0-4d85-a26b-18a247f64621 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.283144 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ff80e2d4-69e0-4d85-a26b-18a247f64621 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.283576 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ff80e2d4-69e0-4d85-a26b-18a247f64621 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.302544 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:28.320584 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-eda7fc97-c8ad-49d4-9418-a5861ed30c37 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 204 len: 0 microversion: 2.1 time: 0.146947 Aug 31 11:10:28.321162 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 302/653] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:10:28 2022] DELETE /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:10:28.331790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e5501992-7782-4a8c-9a19-a2c523eeb456 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:28.332516 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e5501992-7782-4a8c-9a19-a2c523eeb456 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:28.338733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e5501992-7782-4a8c-9a19-a2c523eeb456 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.339413 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e5501992-7782-4a8c-9a19-a2c523eeb456 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.339934 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e5501992-7782-4a8c-9a19-a2c523eeb456 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.340990 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e5501992-7782-4a8c-9a19-a2c523eeb456 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.341432 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e5501992-7782-4a8c-9a19-a2c523eeb456 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.341956 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e5501992-7782-4a8c-9a19-a2c523eeb456 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.440483 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ff80e2d4-69e0-4d85-a26b-18a247f64621 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:28.448531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ff80e2d4-69e0-4d85-a26b-18a247f64621 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1553 microversion: 2.1 time: 0.180077 Aug 31 11:10:28.449331 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 352/654] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:28 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:28.480987 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e5501992-7782-4a8c-9a19-a2c523eeb456 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:28.489340 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e5501992-7782-4a8c-9a19-a2c523eeb456 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1680 microversion: 2.1 time: 0.161957 Aug 31 11:10:28.489899 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 303/655] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:28 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:28.606897 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d3a99dd5-3e50-4801-96f0-7d8191408c10 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:28.607505 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d3a99dd5-3e50-4801-96f0-7d8191408c10 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:28.614365 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3a99dd5-3e50-4801-96f0-7d8191408c10 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.614803 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3a99dd5-3e50-4801-96f0-7d8191408c10 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.615237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3a99dd5-3e50-4801-96f0-7d8191408c10 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.615927 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3a99dd5-3e50-4801-96f0-7d8191408c10 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.616405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3a99dd5-3e50-4801-96f0-7d8191408c10 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.616910 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3a99dd5-3e50-4801-96f0-7d8191408c10 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.744251 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d3a99dd5-3e50-4801-96f0-7d8191408c10 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:28.751912 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d3a99dd5-3e50-4801-96f0-7d8191408c10 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1679 microversion: 2.1 time: 0.148862 Aug 31 11:10:28.752497 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 353/656] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:28 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:28.989963 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-99358e38-ea8d-4de9-8026-49a60d2334e1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:28.990443 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-99358e38-ea8d-4de9-8026-49a60d2334e1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:28.996352 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-99358e38-ea8d-4de9-8026-49a60d2334e1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.996830 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-99358e38-ea8d-4de9-8026-49a60d2334e1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.997256 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-99358e38-ea8d-4de9-8026-49a60d2334e1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:28.997932 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-99358e38-ea8d-4de9-8026-49a60d2334e1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:28.998376 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-99358e38-ea8d-4de9-8026-49a60d2334e1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:28.998789 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-99358e38-ea8d-4de9-8026-49a60d2334e1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:29.079952 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-99358e38-ea8d-4de9-8026-49a60d2334e1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lazy-loading 'services' on Instance uuid f01be6c4-bf01-4970-87ca-7c8e3cf14524 {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:29.151541 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-99358e38-ea8d-4de9-8026-49a60d2334e1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments/48486b7c-e31a-4f04-821c-9e42e2234577" status: 202 len: 0 microversion: 2.1 time: 0.166057 Aug 31 11:10:29.152175 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 304/657] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 11:10:28 2022] DELETE /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments/48486b7c-e31a-4f04-821c-9e42e2234577 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:10:29.160698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d8a20d40-c75f-4f9f-9309-4a9ca63bddb4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:29.163218 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d8a20d40-c75f-4f9f-9309-4a9ca63bddb4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:29.169305 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8a20d40-c75f-4f9f-9309-4a9ca63bddb4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:29.169790 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8a20d40-c75f-4f9f-9309-4a9ca63bddb4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:29.170228 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8a20d40-c75f-4f9f-9309-4a9ca63bddb4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:29.170915 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8a20d40-c75f-4f9f-9309-4a9ca63bddb4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:29.171367 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8a20d40-c75f-4f9f-9309-4a9ca63bddb4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:29.171794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8a20d40-c75f-4f9f-9309-4a9ca63bddb4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:29.201838 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d8a20d40-c75f-4f9f-9309-4a9ca63bddb4 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Aug 31 11:10:29.202395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 354/658] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:10:29 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:29.469749 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-50296aee-3629-4db3-843a-ee85eef0ecad tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:29.470446 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-50296aee-3629-4db3-843a-ee85eef0ecad tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:29.477173 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-50296aee-3629-4db3-843a-ee85eef0ecad tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:29.477653 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-50296aee-3629-4db3-843a-ee85eef0ecad tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:29.478084 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-50296aee-3629-4db3-843a-ee85eef0ecad tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:29.478763 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-50296aee-3629-4db3-843a-ee85eef0ecad tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:29.479213 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-50296aee-3629-4db3-843a-ee85eef0ecad tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:29.479639 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-50296aee-3629-4db3-843a-ee85eef0ecad tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:29.510636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-65c506ac-79e1-457f-ac65-e5160176f769 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:29.511321 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-65c506ac-79e1-457f-ac65-e5160176f769 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:29.517851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-65c506ac-79e1-457f-ac65-e5160176f769 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:29.518334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-65c506ac-79e1-457f-ac65-e5160176f769 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:29.518853 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-65c506ac-79e1-457f-ac65-e5160176f769 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:29.519543 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-65c506ac-79e1-457f-ac65-e5160176f769 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:29.519999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-65c506ac-79e1-457f-ac65-e5160176f769 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:29.520476 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-65c506ac-79e1-457f-ac65-e5160176f769 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:29.610440 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-50296aee-3629-4db3-843a-ee85eef0ecad tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:29.619028 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-50296aee-3629-4db3-843a-ee85eef0ecad tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1553 microversion: 2.1 time: 0.153423 Aug 31 11:10:29.619607 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 305/659] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:29 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:29.654100 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-65c506ac-79e1-457f-ac65-e5160176f769 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:29.662818 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-65c506ac-79e1-457f-ac65-e5160176f769 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1680 microversion: 2.1 time: 0.155991 Aug 31 11:10:29.663376 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 355/660] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:29 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:29.773549 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3b2ff3de-d9ce-469c-b4f6-2cc303082000 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:29.774150 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3b2ff3de-d9ce-469c-b4f6-2cc303082000 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:29.780096 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3b2ff3de-d9ce-469c-b4f6-2cc303082000 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:29.780584 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3b2ff3de-d9ce-469c-b4f6-2cc303082000 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:29.781022 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3b2ff3de-d9ce-469c-b4f6-2cc303082000 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:29.781714 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3b2ff3de-d9ce-469c-b4f6-2cc303082000 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:29.782166 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3b2ff3de-d9ce-469c-b4f6-2cc303082000 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:29.782690 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3b2ff3de-d9ce-469c-b4f6-2cc303082000 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:29.919031 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3b2ff3de-d9ce-469c-b4f6-2cc303082000 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:29.927451 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3b2ff3de-d9ce-469c-b4f6-2cc303082000 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1679 microversion: 2.1 time: 0.157659 Aug 31 11:10:29.928047 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 306/661] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:29 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:30.214401 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-29814664-a16b-4eb8-a869-98e35aa51944 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:30.216667 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-29814664-a16b-4eb8-a869-98e35aa51944 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:30.223240 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-29814664-a16b-4eb8-a869-98e35aa51944 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:30.223718 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-29814664-a16b-4eb8-a869-98e35aa51944 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:30.224179 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-29814664-a16b-4eb8-a869-98e35aa51944 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:30.224862 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-29814664-a16b-4eb8-a869-98e35aa51944 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:30.225306 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-29814664-a16b-4eb8-a869-98e35aa51944 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:30.225725 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-29814664-a16b-4eb8-a869-98e35aa51944 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:30.255896 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-29814664-a16b-4eb8-a869-98e35aa51944 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045427 Aug 31 11:10:30.256829 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 356/662] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:10:30 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:30.640305 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-33d94023-4ed8-4aba-8090-6148dc71d1eb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:30.640830 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-33d94023-4ed8-4aba-8090-6148dc71d1eb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:30.647758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-33d94023-4ed8-4aba-8090-6148dc71d1eb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:30.648268 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-33d94023-4ed8-4aba-8090-6148dc71d1eb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:30.648706 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-33d94023-4ed8-4aba-8090-6148dc71d1eb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:30.649393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-33d94023-4ed8-4aba-8090-6148dc71d1eb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:30.649854 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-33d94023-4ed8-4aba-8090-6148dc71d1eb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:30.650263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-33d94023-4ed8-4aba-8090-6148dc71d1eb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:30.684646 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9fa20a82-4458-4d6d-ab5f-7d151d666ac9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:30.685268 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9fa20a82-4458-4d6d-ab5f-7d151d666ac9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:30.691684 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9fa20a82-4458-4d6d-ab5f-7d151d666ac9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:30.692210 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9fa20a82-4458-4d6d-ab5f-7d151d666ac9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:30.692645 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9fa20a82-4458-4d6d-ab5f-7d151d666ac9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:30.693340 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9fa20a82-4458-4d6d-ab5f-7d151d666ac9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:30.693797 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9fa20a82-4458-4d6d-ab5f-7d151d666ac9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:30.694219 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9fa20a82-4458-4d6d-ab5f-7d151d666ac9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:30.781054 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-33d94023-4ed8-4aba-8090-6148dc71d1eb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:30.790458 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-33d94023-4ed8-4aba-8090-6148dc71d1eb tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1553 microversion: 2.1 time: 0.154127 Aug 31 11:10:30.791036 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 307/663] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:30 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:30.824590 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9fa20a82-4458-4d6d-ab5f-7d151d666ac9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:30.832196 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9fa20a82-4458-4d6d-ab5f-7d151d666ac9 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1680 microversion: 2.1 time: 0.151341 Aug 31 11:10:30.832760 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 357/664] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:30 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:30.949355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c070b307-07f0-4805-8f1e-81a7dd7f7898 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:30.949962 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c070b307-07f0-4805-8f1e-81a7dd7f7898 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:30.955856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c070b307-07f0-4805-8f1e-81a7dd7f7898 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:30.956372 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c070b307-07f0-4805-8f1e-81a7dd7f7898 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:30.956902 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c070b307-07f0-4805-8f1e-81a7dd7f7898 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:30.957590 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c070b307-07f0-4805-8f1e-81a7dd7f7898 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:30.958042 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c070b307-07f0-4805-8f1e-81a7dd7f7898 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:30.958465 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c070b307-07f0-4805-8f1e-81a7dd7f7898 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:31.085498 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c070b307-07f0-4805-8f1e-81a7dd7f7898 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:31.093121 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c070b307-07f0-4805-8f1e-81a7dd7f7898 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1656 microversion: 2.1 time: 0.147619 Aug 31 11:10:31.093694 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 308/665] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:30 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1656 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:31.116174 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1b9fd910-fc1e-4989-a980-48ede16570c4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:31.122042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1b9fd910-fc1e-4989-a980-48ede16570c4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:31.122518 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1b9fd910-fc1e-4989-a980-48ede16570c4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:31.122947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1b9fd910-fc1e-4989-a980-48ede16570c4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:31.144591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1b9fd910-fc1e-4989-a980-48ede16570c4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Going to try to start instance {{(pid=120654) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 11:10:31.187538 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1b9fd910-fc1e-4989-a980-48ede16570c4 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "POST /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/action" status: 202 len: 0 microversion: 2.1 time: 0.075474 Aug 31 11:10:31.189260 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 358/666] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:10:31 2022] POST /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:10:31.197062 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-bd169078-21a9-4a4c-97d5-3c8b20504290 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:31.197660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-bd169078-21a9-4a4c-97d5-3c8b20504290 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:31.203601 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-bd169078-21a9-4a4c-97d5-3c8b20504290 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:31.204033 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-bd169078-21a9-4a4c-97d5-3c8b20504290 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:31.204466 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-bd169078-21a9-4a4c-97d5-3c8b20504290 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:31.205142 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-bd169078-21a9-4a4c-97d5-3c8b20504290 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:31.205584 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-bd169078-21a9-4a4c-97d5-3c8b20504290 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:31.206562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-bd169078-21a9-4a4c-97d5-3c8b20504290 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:31.269446 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c91c8331-83bb-47dc-8961-2b54c0d7a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:31.271670 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c91c8331-83bb-47dc-8961-2b54c0d7a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:31.278011 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c91c8331-83bb-47dc-8961-2b54c0d7a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:31.278496 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c91c8331-83bb-47dc-8961-2b54c0d7a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:31.278931 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c91c8331-83bb-47dc-8961-2b54c0d7a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:31.279626 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c91c8331-83bb-47dc-8961-2b54c0d7a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:31.280143 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c91c8331-83bb-47dc-8961-2b54c0d7a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:31.280559 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c91c8331-83bb-47dc-8961-2b54c0d7a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:31.312716 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c91c8331-83bb-47dc-8961-2b54c0d7a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048210 Aug 31 11:10:31.313290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 359/667] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:10:31 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:10:31.342005 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-bd169078-21a9-4a4c-97d5-3c8b20504290 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:31.350778 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-bd169078-21a9-4a4c-97d5-3c8b20504290 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1665 microversion: 2.1 time: 0.157702 Aug 31 11:10:31.351355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 309/668] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:31 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:31.811991 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fd80820f-9605-4999-937c-e0287450a8c1 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:31.812659 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fd80820f-9605-4999-937c-e0287450a8c1 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:31.819072 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fd80820f-9605-4999-937c-e0287450a8c1 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:31.819582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fd80820f-9605-4999-937c-e0287450a8c1 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:31.819984 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fd80820f-9605-4999-937c-e0287450a8c1 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:31.820715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fd80820f-9605-4999-937c-e0287450a8c1 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:31.821186 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fd80820f-9605-4999-937c-e0287450a8c1 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:31.821604 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fd80820f-9605-4999-937c-e0287450a8c1 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:31.853722 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7fbb85fa-ffbc-426e-a8bf-86715ea00721 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:31.854344 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-7fbb85fa-ffbc-426e-a8bf-86715ea00721 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:31.860866 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fbb85fa-ffbc-426e-a8bf-86715ea00721 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:31.861353 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fbb85fa-ffbc-426e-a8bf-86715ea00721 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:31.861800 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fbb85fa-ffbc-426e-a8bf-86715ea00721 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:31.863181 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fbb85fa-ffbc-426e-a8bf-86715ea00721 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:31.863645 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fbb85fa-ffbc-426e-a8bf-86715ea00721 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:31.864095 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fbb85fa-ffbc-426e-a8bf-86715ea00721 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:31.956547 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fd80820f-9605-4999-937c-e0287450a8c1 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:31.964600 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fd80820f-9605-4999-937c-e0287450a8c1 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1553 microversion: 2.1 time: 0.156618 Aug 31 11:10:31.965246 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 360/669] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:31 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:32.088062 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7fbb85fa-ffbc-426e-a8bf-86715ea00721 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:32.095633 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7fbb85fa-ffbc-426e-a8bf-86715ea00721 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1680 microversion: 2.1 time: 0.245820 Aug 31 11:10:32.096227 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 310/670] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:31 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:32.326771 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4db7e424-5834-4647-bfaa-f540c2849f90 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:32.329967 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4db7e424-5834-4647-bfaa-f540c2849f90 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:32.337957 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4db7e424-5834-4647-bfaa-f540c2849f90 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:32.339181 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4db7e424-5834-4647-bfaa-f540c2849f90 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:32.339181 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4db7e424-5834-4647-bfaa-f540c2849f90 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:32.340578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4db7e424-5834-4647-bfaa-f540c2849f90 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:32.341182 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4db7e424-5834-4647-bfaa-f540c2849f90 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:32.341602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4db7e424-5834-4647-bfaa-f540c2849f90 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:32.375265 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-44c72d84-e6e1-4932-9891-dc5e3f3bc7f6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:32.376438 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-44c72d84-e6e1-4932-9891-dc5e3f3bc7f6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:32.379873 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4db7e424-5834-4647-bfaa-f540c2849f90 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058283 Aug 31 11:10:32.381134 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 361/671] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:10:32 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:10:32.389227 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-44c72d84-e6e1-4932-9891-dc5e3f3bc7f6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:32.389737 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-44c72d84-e6e1-4932-9891-dc5e3f3bc7f6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:32.390169 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-44c72d84-e6e1-4932-9891-dc5e3f3bc7f6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:32.390868 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-44c72d84-e6e1-4932-9891-dc5e3f3bc7f6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:32.391318 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-44c72d84-e6e1-4932-9891-dc5e3f3bc7f6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:32.391769 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-44c72d84-e6e1-4932-9891-dc5e3f3bc7f6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:32.810733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-44c72d84-e6e1-4932-9891-dc5e3f3bc7f6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:32.819302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-44c72d84-e6e1-4932-9891-dc5e3f3bc7f6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1665 microversion: 2.1 time: 0.452005 Aug 31 11:10:32.819873 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 311/672] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:32 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1665 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:32.987388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6b1c5e8d-73f0-490a-996f-e6d969cef644 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:32.988147 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6b1c5e8d-73f0-490a-996f-e6d969cef644 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:32.994127 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6b1c5e8d-73f0-490a-996f-e6d969cef644 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:32.994635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6b1c5e8d-73f0-490a-996f-e6d969cef644 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:32.995077 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6b1c5e8d-73f0-490a-996f-e6d969cef644 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:32.995769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6b1c5e8d-73f0-490a-996f-e6d969cef644 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:32.996249 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6b1c5e8d-73f0-490a-996f-e6d969cef644 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:32.996707 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6b1c5e8d-73f0-490a-996f-e6d969cef644 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:33.119469 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-49a154bb-c188-438e-9b55-7ec09ea7a9fd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:33.120132 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-49a154bb-c188-438e-9b55-7ec09ea7a9fd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:33.137660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-49a154bb-c188-438e-9b55-7ec09ea7a9fd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:33.138373 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-49a154bb-c188-438e-9b55-7ec09ea7a9fd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:33.140071 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-49a154bb-c188-438e-9b55-7ec09ea7a9fd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:33.141199 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-49a154bb-c188-438e-9b55-7ec09ea7a9fd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:33.141797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-49a154bb-c188-438e-9b55-7ec09ea7a9fd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:33.142762 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-49a154bb-c188-438e-9b55-7ec09ea7a9fd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:33.154515 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6b1c5e8d-73f0-490a-996f-e6d969cef644 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:33.169329 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6b1c5e8d-73f0-490a-996f-e6d969cef644 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1553 microversion: 2.1 time: 0.186329 Aug 31 11:10:33.170611 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 362/673] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:32 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:33.295902 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-1e16863c-b92a-4eda-8b63-f0b1fccb31ff req-d065d526-8f56-4e53-82e6-f5b5bb4d42af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ab2526-7363-4846-86d8-cb2fa6705c76", "name": "network-vif-deleted", "tag": "7b6fd60a-b00d-41c8-912f-b319241ebfad"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:33.317529 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-1e16863c-b92a-4eda-8b63-f0b1fccb31ff req-d065d526-8f56-4e53-82e6-f5b5bb4d42af service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:33.318005 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-1e16863c-b92a-4eda-8b63-f0b1fccb31ff req-d065d526-8f56-4e53-82e6-f5b5bb4d42af service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:33.321345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-1e16863c-b92a-4eda-8b63-f0b1fccb31ff req-d065d526-8f56-4e53-82e6-f5b5bb4d42af service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:33.336213 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-1e16863c-b92a-4eda-8b63-f0b1fccb31ff req-d065d526-8f56-4e53-82e6-f5b5bb4d42af service nova] Creating event network-vif-deleted:7b6fd60a-b00d-41c8-912f-b319241ebfad for instance f1ab2526-7363-4846-86d8-cb2fa6705c76 on hv-cinder-85535 Aug 31 11:10:33.342063 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-1e16863c-b92a-4eda-8b63-f0b1fccb31ff req-d065d526-8f56-4e53-82e6-f5b5bb4d42af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050498 Aug 31 11:10:33.343311 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 363/674] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:33.393350 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7a070d6e-aea5-4ebb-b48e-d61cc2025e30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:33.396341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7a070d6e-aea5-4ebb-b48e-d61cc2025e30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:33.404064 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7a070d6e-aea5-4ebb-b48e-d61cc2025e30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:33.404582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7a070d6e-aea5-4ebb-b48e-d61cc2025e30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:33.405144 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7a070d6e-aea5-4ebb-b48e-d61cc2025e30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:33.405945 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7a070d6e-aea5-4ebb-b48e-d61cc2025e30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:33.406400 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7a070d6e-aea5-4ebb-b48e-d61cc2025e30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:33.406827 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7a070d6e-aea5-4ebb-b48e-d61cc2025e30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:33.445734 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7a070d6e-aea5-4ebb-b48e-d61cc2025e30 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056896 Aug 31 11:10:33.451731 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 364/675] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:10:33 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 11:10:33.546484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ddebe1ae-af55-43a8-9963-eff9bb85cdc7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:33.547072 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ddebe1ae-af55-43a8-9963-eff9bb85cdc7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:33.557560 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ddebe1ae-af55-43a8-9963-eff9bb85cdc7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:33.558601 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ddebe1ae-af55-43a8-9963-eff9bb85cdc7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:33.559191 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ddebe1ae-af55-43a8-9963-eff9bb85cdc7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:33.560173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ddebe1ae-af55-43a8-9963-eff9bb85cdc7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:33.560771 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ddebe1ae-af55-43a8-9963-eff9bb85cdc7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:33.561492 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ddebe1ae-af55-43a8-9963-eff9bb85cdc7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:33.614370 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ddebe1ae-af55-43a8-9963-eff9bb85cdc7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:10:33.722387 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ddebe1ae-af55-43a8-9963-eff9bb85cdc7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 204 len: 0 microversion: 2.1 time: 0.179434 Aug 31 11:10:33.726224 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 365/676] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:10:33 2022] DELETE /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:10:33.736462 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a4d00ae2-70c7-481e-bf61-079d006fe1a7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:33.736740 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a4d00ae2-70c7-481e-bf61-079d006fe1a7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:33.745545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a4d00ae2-70c7-481e-bf61-079d006fe1a7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:33.745984 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a4d00ae2-70c7-481e-bf61-079d006fe1a7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:33.746418 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a4d00ae2-70c7-481e-bf61-079d006fe1a7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:33.747123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a4d00ae2-70c7-481e-bf61-079d006fe1a7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:33.747865 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a4d00ae2-70c7-481e-bf61-079d006fe1a7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:33.748160 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a4d00ae2-70c7-481e-bf61-079d006fe1a7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:33.803089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-49a154bb-c188-438e-9b55-7ec09ea7a9fd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:33.812535 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-49a154bb-c188-438e-9b55-7ec09ea7a9fd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1680 microversion: 2.1 time: 0.697326 Aug 31 11:10:33.818410 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 312/677] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:33 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1680 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:33.841367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0e75e69c-e1e8-4ea1-b37c-5da229a605d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:33.842421 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0e75e69c-e1e8-4ea1-b37c-5da229a605d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:33.849710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0e75e69c-e1e8-4ea1-b37c-5da229a605d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:33.850526 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0e75e69c-e1e8-4ea1-b37c-5da229a605d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:33.851209 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0e75e69c-e1e8-4ea1-b37c-5da229a605d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:33.852037 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0e75e69c-e1e8-4ea1-b37c-5da229a605d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:33.852573 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0e75e69c-e1e8-4ea1-b37c-5da229a605d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:33.853174 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0e75e69c-e1e8-4ea1-b37c-5da229a605d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:33.917041 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a4d00ae2-70c7-481e-bf61-079d006fe1a7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:33.925752 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a4d00ae2-70c7-481e-bf61-079d006fe1a7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1688 microversion: 2.1 time: 0.196028 Aug 31 11:10:33.926327 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 366/678] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:33 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:34.056437 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0e75e69c-e1e8-4ea1-b37c-5da229a605d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:34.066133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0e75e69c-e1e8-4ea1-b37c-5da229a605d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1665 microversion: 2.1 time: 0.228785 Aug 31 11:10:34.066716 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 313/679] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:33 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1665 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:34.201440 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:34.204122 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:34.218123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:34.218722 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:34.219363 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:34.220371 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:34.221172 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:34.223957 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:34.231466 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:34.282686 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:34.283329 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:34.284534 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:34.285068 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lazy-loading 'fault' on Instance uuid f1ab2526-7363-4846-86d8-cb2fa6705c76 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:34.335676 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:34.343830 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7bac284d-ec42-47c1-9f41-d04117c9bf3f tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1348 microversion: 2.1 time: 0.156776 Aug 31 11:10:34.348204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 367/680] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:34 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1348 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:34.835245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-79fc3cb5-09e4-4d00-9f3f-86c8c8ac97c3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:34.835779 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-79fc3cb5-09e4-4d00-9f3f-86c8c8ac97c3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:34.842121 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-79fc3cb5-09e4-4d00-9f3f-86c8c8ac97c3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:34.842601 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-79fc3cb5-09e4-4d00-9f3f-86c8c8ac97c3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:34.843036 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-79fc3cb5-09e4-4d00-9f3f-86c8c8ac97c3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:34.843728 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-79fc3cb5-09e4-4d00-9f3f-86c8c8ac97c3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:34.844218 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-79fc3cb5-09e4-4d00-9f3f-86c8c8ac97c3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:34.844643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-79fc3cb5-09e4-4d00-9f3f-86c8c8ac97c3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:34.908179 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-79fc3cb5-09e4-4d00-9f3f-86c8c8ac97c3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:34.917016 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-79fc3cb5-09e4-4d00-9f3f-86c8c8ac97c3 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1612 microversion: 2.1 time: 0.086079 Aug 31 11:10:34.917613 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 314/681] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:34 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1612 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:34.946610 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3ef5c131-ae01-4d5c-93f2-050bc904b0b1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:34.947364 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3ef5c131-ae01-4d5c-93f2-050bc904b0b1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:34.954586 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3ef5c131-ae01-4d5c-93f2-050bc904b0b1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:34.954586 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3ef5c131-ae01-4d5c-93f2-050bc904b0b1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:34.955116 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3ef5c131-ae01-4d5c-93f2-050bc904b0b1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:34.956622 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3ef5c131-ae01-4d5c-93f2-050bc904b0b1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:34.957184 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3ef5c131-ae01-4d5c-93f2-050bc904b0b1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:34.957818 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3ef5c131-ae01-4d5c-93f2-050bc904b0b1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:35.086856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-21fb5203-d006-4fb6-9667-9dce6c09e16a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:35.087384 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-21fb5203-d006-4fb6-9667-9dce6c09e16a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:35.090360 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:35.093834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-3ef5c131-ae01-4d5c-93f2-050bc904b0b1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:35.094003 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-21fb5203-d006-4fb6-9667-9dce6c09e16a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:35.094430 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-21fb5203-d006-4fb6-9667-9dce6c09e16a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:35.094862 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-21fb5203-d006-4fb6-9667-9dce6c09e16a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:35.095555 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-21fb5203-d006-4fb6-9667-9dce6c09e16a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:35.096020 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-21fb5203-d006-4fb6-9667-9dce6c09e16a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:35.096503 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-21fb5203-d006-4fb6-9667-9dce6c09e16a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:35.103015 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3ef5c131-ae01-4d5c-93f2-050bc904b0b1 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1688 microversion: 2.1 time: 0.160172 Aug 31 11:10:35.103633 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 368/682] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:34 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:35.243632 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-21fb5203-d006-4fb6-9667-9dce6c09e16a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:35.251404 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-21fb5203-d006-4fb6-9667-9dce6c09e16a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1665 microversion: 2.1 time: 0.168496 Aug 31 11:10:35.251967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 315/683] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:35 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1665 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:35.366707 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:35.367304 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:35.373945 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:35.374441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:35.374861 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:35.375525 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:35.376022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:35.376428 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:35.409641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:35.410324 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:35.410792 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:35.411587 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lazy-loading 'fault' on Instance uuid f1ab2526-7363-4846-86d8-cb2fa6705c76 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:35.452425 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:35.461473 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2a8b0ee9-17b1-4621-8273-85a888fc9f29 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1348 microversion: 2.1 time: 0.099166 Aug 31 11:10:35.462059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 369/684] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:35 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:35.634843 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-2683c743-850d-4e6c-8791-036480bc045b req-0592f13b-3c87-456d-9d85-90f355092451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f70e795-e50c-414e-b302-2b818ce84337", "name": "network-vif-deleted", "tag": "1facded0-b145-4c4f-a2ec-cbef8e6d0174"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:35.640013 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 11:10:35.640168 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Wed Aug 31 11:10:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Aug 31 11:10:35.647194 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-2683c743-850d-4e6c-8791-036480bc045b req-0592f13b-3c87-456d-9d85-90f355092451 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:35.647663 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-2683c743-850d-4e6c-8791-036480bc045b req-0592f13b-3c87-456d-9d85-90f355092451 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:35.648117 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-2683c743-850d-4e6c-8791-036480bc045b req-0592f13b-3c87-456d-9d85-90f355092451 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:35.659591 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-2683c743-850d-4e6c-8791-036480bc045b req-0592f13b-3c87-456d-9d85-90f355092451 service nova] Creating event network-vif-deleted:1facded0-b145-4c4f-a2ec-cbef8e6d0174 for instance 2f70e795-e50c-414e-b302-2b818ce84337 on hv-cinder-85535 Aug 31 11:10:35.664638 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-2683c743-850d-4e6c-8791-036480bc045b req-0592f13b-3c87-456d-9d85-90f355092451 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033536 Aug 31 11:10:35.665260 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 316/685] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:35.939260 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-052b75b8-3b75-449d-b1c4-fab20a9d24e2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:35.939860 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-052b75b8-3b75-449d-b1c4-fab20a9d24e2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:35.945944 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-052b75b8-3b75-449d-b1c4-fab20a9d24e2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:35.946418 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-052b75b8-3b75-449d-b1c4-fab20a9d24e2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:35.946850 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-052b75b8-3b75-449d-b1c4-fab20a9d24e2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:35.947521 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-052b75b8-3b75-449d-b1c4-fab20a9d24e2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:35.947963 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-052b75b8-3b75-449d-b1c4-fab20a9d24e2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:35.948400 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-052b75b8-3b75-449d-b1c4-fab20a9d24e2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:36.008567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-052b75b8-3b75-449d-b1c4-fab20a9d24e2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:36.016174 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-052b75b8-3b75-449d-b1c4-fab20a9d24e2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1612 microversion: 2.1 time: 0.080701 Aug 31 11:10:36.016735 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 370/686] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:35 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1612 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:36.126078 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9afca564-ebf5-4c5d-8535-279270228c0c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:36.126771 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-9afca564-ebf5-4c5d-8535-279270228c0c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:36.133575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9afca564-ebf5-4c5d-8535-279270228c0c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:36.134049 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9afca564-ebf5-4c5d-8535-279270228c0c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:36.134478 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9afca564-ebf5-4c5d-8535-279270228c0c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:36.135164 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9afca564-ebf5-4c5d-8535-279270228c0c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:36.135616 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9afca564-ebf5-4c5d-8535-279270228c0c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:36.136067 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9afca564-ebf5-4c5d-8535-279270228c0c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:36.270881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-9afca564-ebf5-4c5d-8535-279270228c0c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:36.273323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-81ad9696-4683-454b-81e0-e237d8cd77ce tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:36.273936 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-81ad9696-4683-454b-81e0-e237d8cd77ce tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:36.274416 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:36.279637 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-9afca564-ebf5-4c5d-8535-279270228c0c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1688 microversion: 2.1 time: 0.158374 Aug 31 11:10:36.279909 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-81ad9696-4683-454b-81e0-e237d8cd77ce tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:36.280240 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 317/687] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:36 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:36.280425 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-81ad9696-4683-454b-81e0-e237d8cd77ce tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:36.280859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-81ad9696-4683-454b-81e0-e237d8cd77ce tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:36.281681 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-81ad9696-4683-454b-81e0-e237d8cd77ce tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:36.282165 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-81ad9696-4683-454b-81e0-e237d8cd77ce tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:36.287447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-81ad9696-4683-454b-81e0-e237d8cd77ce tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:36.415559 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-81ad9696-4683-454b-81e0-e237d8cd77ce tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:36.423819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-81ad9696-4683-454b-81e0-e237d8cd77ce tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1665 microversion: 2.1 time: 0.154943 Aug 31 11:10:36.424420 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 371/688] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:36 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:36.481724 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:36.482250 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:36.490060 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:36.490585 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:36.491036 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:36.491718 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:36.492372 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:36.492789 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:36.523019 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:36.523488 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:36.523910 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:36.524375 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lazy-loading 'fault' on Instance uuid f1ab2526-7363-4846-86d8-cb2fa6705c76 {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:36.564462 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:36.572034 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a6a6d200-ae6b-4668-af91-33a22429629d tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1348 microversion: 2.1 time: 0.094157 Aug 31 11:10:36.572702 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 318/689] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:36 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:37.037910 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:37.038570 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:37.044533 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:37.045004 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:37.045434 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:37.046105 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:37.046554 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:37.046970 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:37.077121 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:37.077589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:37.078014 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:37.078451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lazy-loading 'fault' on Instance uuid 2f70e795-e50c-414e-b302-2b818ce84337 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:37.118629 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:37.126253 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ca6e965f-9dd9-4d69-aa69-2fb7e6433c7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1331 microversion: 2.1 time: 0.092536 Aug 31 11:10:37.126814 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 372/690] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:37 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:37.302643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-13801397-a733-4d3f-aadf-f7d9198b5afe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:37.303245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-13801397-a733-4d3f-aadf-f7d9198b5afe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:37.309720 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-13801397-a733-4d3f-aadf-f7d9198b5afe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:37.310192 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-13801397-a733-4d3f-aadf-f7d9198b5afe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:37.310618 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-13801397-a733-4d3f-aadf-f7d9198b5afe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:37.311303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-13801397-a733-4d3f-aadf-f7d9198b5afe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:37.311748 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-13801397-a733-4d3f-aadf-f7d9198b5afe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:37.312191 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-13801397-a733-4d3f-aadf-f7d9198b5afe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:37.450407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-13801397-a733-4d3f-aadf-f7d9198b5afe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:37.461247 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-bade5fbf-d106-43d1-8147-945ba5e651d1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:37.466053 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-13801397-a733-4d3f-aadf-f7d9198b5afe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1688 microversion: 2.1 time: 0.167645 Aug 31 11:10:37.466333 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-bade5fbf-d106-43d1-8147-945ba5e651d1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:37.468702 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 319/691] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:37 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:37.479597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bade5fbf-d106-43d1-8147-945ba5e651d1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:37.479597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bade5fbf-d106-43d1-8147-945ba5e651d1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:37.479597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bade5fbf-d106-43d1-8147-945ba5e651d1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:37.479597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bade5fbf-d106-43d1-8147-945ba5e651d1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:37.480031 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bade5fbf-d106-43d1-8147-945ba5e651d1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:37.480031 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bade5fbf-d106-43d1-8147-945ba5e651d1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:37.593010 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:37.593616 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:37.599984 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:37.600544 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:37.600981 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:37.601677 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:37.602125 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:37.602546 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:37.616067 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-bade5fbf-d106-43d1-8147-945ba5e651d1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:37.623914 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-bade5fbf-d106-43d1-8147-945ba5e651d1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1669 microversion: 2.1 time: 0.181860 Aug 31 11:10:37.624505 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 373/692] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:37 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1669 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:37.634081 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:37.634562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:37.634995 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:37.635434 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lazy-loading 'fault' on Instance uuid f1ab2526-7363-4846-86d8-cb2fa6705c76 {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:37.676534 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fa7242b82941cc9ef9f21f122b1e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4af9139d2b47cf8ea8646c5a4f4a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:37.684101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0b6fa1e9-7413-499b-863a-5c13f64839de tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 200 len: 1348 microversion: 2.1 time: 0.094931 Aug 31 11:10:37.684664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 320/693] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:37 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:38.148648 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:38.149167 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:38.155104 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:38.155560 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:38.156042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:38.156746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:38.157171 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:38.157583 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:38.188466 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:38.188949 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:38.189380 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:38.189824 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lazy-loading 'fault' on Instance uuid 2f70e795-e50c-414e-b302-2b818ce84337 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:38.232052 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:38.240395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9ab01c0d-8308-4074-bbf6-a85f818c55b2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 200 len: 1331 microversion: 2.1 time: 0.095482 Aug 31 11:10:38.240967 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 374/694] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:38 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:38.494787 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cca5a24e-e62c-47b7-becf-ecd48e5df84d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:38.495621 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-cca5a24e-e62c-47b7-becf-ecd48e5df84d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:38.504065 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cca5a24e-e62c-47b7-becf-ecd48e5df84d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:38.504848 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cca5a24e-e62c-47b7-becf-ecd48e5df84d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:38.505677 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cca5a24e-e62c-47b7-becf-ecd48e5df84d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:38.506476 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cca5a24e-e62c-47b7-becf-ecd48e5df84d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:38.506999 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cca5a24e-e62c-47b7-becf-ecd48e5df84d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:38.507407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cca5a24e-e62c-47b7-becf-ecd48e5df84d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:38.591382 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-cca5a24e-e62c-47b7-becf-ecd48e5df84d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:38.599178 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-cca5a24e-e62c-47b7-becf-ecd48e5df84d tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 200 len: 1621 microversion: 2.1 time: 0.109286 Aug 31 11:10:38.599951 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 321/695] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:38 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 1621 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:38.705290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-646a2f2e-d059-4faa-9063-294a3fb6a1df tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:38.706887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-646a2f2e-d059-4faa-9063-294a3fb6a1df tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] [instance: f1ab2526-7363-4846-86d8-cb2fa6705c76] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:38.713002 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-646a2f2e-d059-4faa-9063-294a3fb6a1df tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:38.713503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-646a2f2e-d059-4faa-9063-294a3fb6a1df tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:38.713918 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-646a2f2e-d059-4faa-9063-294a3fb6a1df tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:38.714612 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-646a2f2e-d059-4faa-9063-294a3fb6a1df tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:38.715057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-646a2f2e-d059-4faa-9063-294a3fb6a1df tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:38.715498 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-646a2f2e-d059-4faa-9063-294a3fb6a1df tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:38.730385 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-646a2f2e-d059-4faa-9063-294a3fb6a1df tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] HTTP exception thrown: Instance f1ab2526-7363-4846-86d8-cb2fa6705c76 could not be found. Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-646a2f2e-d059-4faa-9063-294a3fb6a1df tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Request method failure captured: Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 HTTP/1.1 Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0DBEewiVWl9LIOWwD3b_0LV5k3vbSv_AGspWhvgzNUfKvUkmb5wD-3AgfazBMcLLeqHScqssDtkQu68h5Gozclvv3WzGWkKK-JzhDVJWkpedjsChzVxsTgEkb2ufzrfRXa6ngaKtVAhgvxMLvTy1vW9t8W6PYfCt66CfGZeIxmleVE Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 6e4af9139d2b47cf8ea8646c5a4f4a9f Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-TestMinimumBasicScenario-543014898 Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:10:38.732061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:10:38.733673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e4af9139d2b47cf8ea8646c5a4f4a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e4af9139d2b47cf8ea8646c5a4f4a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e4af9139d2b47cf8ea8646c5a4f4a9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e4af9139d2b47cf8ea8646c5a4f4a9f"}]}] Aug 31 11:10:38.733673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-TestMinimumBasicScenario-543014898 Aug 31 11:10:38.733673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 6e4af9139d2b47cf8ea8646c5a4f4a9f Aug 31 11:10:38.733673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-TestMinimumBasicScenario-543014898 Aug 31 11:10:38.733673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-TestMinimumBasicScenario-543014898-project Aug 31 11:10:38.733673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:10:38.733673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:10:38.733673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 74fa7242b82941cc9ef9f21f122b1e4c Aug 31 11:10:38.733673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-TestMinimumBasicScenario-543014898-project Aug 31 11:10:38.733673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:10:38.733673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance f1ab2526-7363-4846-86d8-cb2fa6705c76 could not be found. Aug 31 11:10:38.733673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': 'f1ab2526-7363-4846-86d8-cb2fa6705c76'} Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ab2526-7363-4846-86d8-cb2fa6705c76 could not be found. Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:10:38.734668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ab2526-7363-4846-86d8-cb2fa6705c76 could not be found. Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ab2526-7363-4846-86d8-cb2fa6705c76 could not be found. Aug 31 11:10:38.736130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:10:38.737663 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-646a2f2e-d059-4faa-9063-294a3fb6a1df tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Returning 404 to user: Instance f1ab2526-7363-4846-86d8-cb2fa6705c76 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:10:38.737663 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-646a2f2e-d059-4faa-9063-294a3fb6a1df tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76" status: 404 len: 111 microversion: 2.1 time: 0.032017 Aug 31 11:10:38.737663 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 375/696] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:38 2022] GET /compute/v2.1/servers/f1ab2526-7363-4846-86d8-cb2fa6705c76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:10:38.742622 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-20d56635-5ed6-470c-99a5-483f71a60347 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] Calling method '.version_select at 0x7f732d33a670>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:38.763187 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-20d56635-5ed6-470c-99a5-483f71a60347 tempest-TestMinimumBasicScenario-543014898 tempest-TestMinimumBasicScenario-543014898-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-400811564" status: 202 len: 0 microversion: 2.1 time: 0.024341 Aug 31 11:10:38.764132 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 322/697] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Aug 31 11:10:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-400811564 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:10:38.785409 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-a3d95866-fcb2-4237-ac10-bf4bd0731464 req-1b6accdf-af9d-4679-b2e6-a0a4a459ca6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01be6c4-bf01-4970-87ca-7c8e3cf14524", "name": "network-vif-deleted", "tag": "a567e33c-5895-4192-99c1-30a51a815ee5"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:38.791893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-a3d95866-fcb2-4237-ac10-bf4bd0731464 req-1b6accdf-af9d-4679-b2e6-a0a4a459ca6a service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:38.792532 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-a3d95866-fcb2-4237-ac10-bf4bd0731464 req-1b6accdf-af9d-4679-b2e6-a0a4a459ca6a service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:38.793019 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-a3d95866-fcb2-4237-ac10-bf4bd0731464 req-1b6accdf-af9d-4679-b2e6-a0a4a459ca6a service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:38.811628 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-a3d95866-fcb2-4237-ac10-bf4bd0731464 req-1b6accdf-af9d-4679-b2e6-a0a4a459ca6a service nova] Creating event network-vif-deleted:a567e33c-5895-4192-99c1-30a51a815ee5 for instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 on hv-cinder-85535 Aug 31 11:10:38.821887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-a3d95866-fcb2-4237-ac10-bf4bd0731464 req-1b6accdf-af9d-4679-b2e6-a0a4a459ca6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044312 Aug 31 11:10:38.822855 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 376/698] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:39.261458 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5052b1e5-c9d2-4e5c-92ba-9e2472085e04 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:39.262061 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-5052b1e5-c9d2-4e5c-92ba-9e2472085e04 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:39.268599 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5052b1e5-c9d2-4e5c-92ba-9e2472085e04 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:39.269070 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5052b1e5-c9d2-4e5c-92ba-9e2472085e04 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:39.269405 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5052b1e5-c9d2-4e5c-92ba-9e2472085e04 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:39.270103 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5052b1e5-c9d2-4e5c-92ba-9e2472085e04 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:39.270556 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5052b1e5-c9d2-4e5c-92ba-9e2472085e04 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:39.270978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5052b1e5-c9d2-4e5c-92ba-9e2472085e04 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:39.285819 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-5052b1e5-c9d2-4e5c-92ba-9e2472085e04 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5052b1e5-c9d2-4e5c-92ba-9e2472085e04 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 HTTP/1.1 Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:10:39.287752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:10:39.289292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:10:39.289292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:10:39.289292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:10:39.289292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:10:39.289292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:10:39.289292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:10:39.289292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:10:39.289292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:10:39.289292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:10:39.289292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:10:39.289292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:10:39.289292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '2f70e795-e50c-414e-b302-2b818ce84337'} Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:10:39.290115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:10:39.291237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:39.292355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5052b1e5-c9d2-4e5c-92ba-9e2472085e04 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 404 to user: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:10:39.292355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-5052b1e5-c9d2-4e5c-92ba-9e2472085e04 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 404 len: 111 microversion: 2.1 time: 0.031734 Aug 31 11:10:39.292355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 323/699] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:39 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:10:39.300167 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-56dc5552-34d9-4ffb-bdd8-4d055e2e3a1b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '.version_select at 0x7f732d159d30>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:39.341435 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-56dc5552-34d9-4ffb-bdd8-4d055e2e3a1b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060852104" status: 202 len: 0 microversion: 2.1 time: 0.046472 Aug 31 11:10:39.342206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 377/700] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 31 11:10:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060852104 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:10:39.620525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e508a5b9-358a-4010-a2c3-062e9dbb9d8c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:39.621133 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e508a5b9-358a-4010-a2c3-062e9dbb9d8c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: f01be6c4-bf01-4970-87ca-7c8e3cf14524] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:39.627614 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e508a5b9-358a-4010-a2c3-062e9dbb9d8c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:39.628222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e508a5b9-358a-4010-a2c3-062e9dbb9d8c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:39.628656 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e508a5b9-358a-4010-a2c3-062e9dbb9d8c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:39.629361 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e508a5b9-358a-4010-a2c3-062e9dbb9d8c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:39.629809 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e508a5b9-358a-4010-a2c3-062e9dbb9d8c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:39.630228 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e508a5b9-358a-4010-a2c3-062e9dbb9d8c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:39.651754 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-e508a5b9-358a-4010-a2c3-062e9dbb9d8c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] HTTP exception thrown: Instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 could not be found. Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e508a5b9-358a-4010-a2c3-062e9dbb9d8c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Request method failure captured: Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 HTTP/1.1 Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0B3pxnNtheXxMA108K-k3aets4iDu1xumVDmbwkNyulZyujoyRzznHgfG-H745bhKzmC_tincuwf2-1k2WKMJBp3v_5eKOI2HXs-BSvvXLY5ppaBAEot0sxP3oNxqcqTMTOtvZEHhj2BQuPOndfD2LNaMReJc2hJWcOZYGeTmQONow Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 9ceec51e430e4a00b407068a2243be63 Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:10:39.653561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:10:39.655145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ceec51e430e4a00b407068a2243be63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ceec51e430e4a00b407068a2243be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ceec51e430e4a00b407068a2243be63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ceec51e430e4a00b407068a2243be63"}]}] Aug 31 11:10:39.655145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:10:39.655145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 9ceec51e430e4a00b407068a2243be63 Aug 31 11:10:39.655145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:10:39.655145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-ServerRescueNegativeTestJSON-92711221-project Aug 31 11:10:39.655145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:10:39.655145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:10:39.655145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 19643be9952649aba81e61d5d55290c4 Aug 31 11:10:39.655145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-ServerRescueNegativeTestJSON-92711221-project Aug 31 11:10:39.655145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:10:39.655145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 could not be found. Aug 31 11:10:39.655145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': 'f01be6c4-bf01-4970-87ca-7c8e3cf14524'} Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 could not be found. Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:10:39.656026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 could not be found. Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 could not be found. Aug 31 11:10:39.657390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:39.658634 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e508a5b9-358a-4010-a2c3-062e9dbb9d8c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Returning 404 to user: Instance f01be6c4-bf01-4970-87ca-7c8e3cf14524 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:10:39.658634 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e508a5b9-358a-4010-a2c3-062e9dbb9d8c tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524" status: 404 len: 111 microversion: 2.1 time: 0.038700 Aug 31 11:10:39.659084 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 324/701] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:39 2022] GET /compute/v2.1/servers/f01be6c4-bf01-4970-87ca-7c8e3cf14524 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:10:39.665029 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4887b00d-b909-479f-a39e-2064e6379481 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '.version_select at 0x7f732d166310>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:39.691795 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4887b00d-b909-479f-a39e-2064e6379481 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-226963771" status: 202 len: 0 microversion: 2.1 time: 0.031072 Aug 31 11:10:39.696874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 378/702] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Aug 31 11:10:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-226963771 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:10:40.663164 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8de5f011-d9e6-4339-b4d6-1f9221a07be6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: .version_select at 0x7f732d395790>, body: {"keypair": {"name": "tempest-keypair-2128469173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW8MV9KlZQURESaX4vqG5zwNPTGib8ZupjIfXppKs3+VSBQXmleqdAQHoCt4qop2Af0dUKP/M+fR40IUF2aKgBHiA075K4mg+TDoXmuN7nrVkXx5lpnsyJd7L+wGKDqvA=="}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:40.679422 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-8de5f011-d9e6-4339-b4d6-1f9221a07be6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:10:40.683182 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-8de5f011-d9e6-4339-b4d6-1f9221a07be6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for user d0e5dae087184c56b1cb72fb7705d4d5 and project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'key_pairs'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:10:40.705789 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8de5f011-d9e6-4339-b4d6-1f9221a07be6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047118 Aug 31 11:10:40.706836 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 325/703] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 11:10:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:42.095097 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-982342255", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6f1d69a-015b-48c6-bbc4-eabba1f958e8"}], "security_groups": [{"name": "tempest-securitygroup--1054034708"}], "key_name": "tempest-keypair-2128469173", "user_data": "}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:42.249416 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] validate_networks() for [('b6f1d69a-015b-48c6-bbc4-eabba1f958e8', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:10:42.693111 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8eebf638-5516-438f-8d65-ff422249a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:42.694163 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8eebf638-5516-438f-8d65-ff422249a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:42.700316 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8eebf638-5516-438f-8d65-ff422249a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:42.701029 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8eebf638-5516-438f-8d65-ff422249a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:42.701676 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8eebf638-5516-438f-8d65-ff422249a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:42.702754 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8eebf638-5516-438f-8d65-ff422249a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:42.703384 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8eebf638-5516-438f-8d65-ff422249a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:42.704037 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8eebf638-5516-438f-8d65-ff422249a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:42.731840 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8eebf638-5516-438f-8d65-ff422249a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Going to try to terminate instance {{(pid=120655) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:10:42.809330 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8eebf638-5516-438f-8d65-ff422249a59b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 204 len: 0 microversion: 2.1 time: 0.120472 Aug 31 11:10:42.813159 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 326/704] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:10:42 2022] DELETE /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:10:42.819512 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a3c8c6f0-1dd7-4f68-a66f-53ebe90f6ac2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:42.820247 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a3c8c6f0-1dd7-4f68-a66f-53ebe90f6ac2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:42.826111 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a3c8c6f0-1dd7-4f68-a66f-53ebe90f6ac2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:42.826595 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a3c8c6f0-1dd7-4f68-a66f-53ebe90f6ac2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:42.827029 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a3c8c6f0-1dd7-4f68-a66f-53ebe90f6ac2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:42.827721 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a3c8c6f0-1dd7-4f68-a66f-53ebe90f6ac2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:42.828206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a3c8c6f0-1dd7-4f68-a66f-53ebe90f6ac2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:42.828629 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a3c8c6f0-1dd7-4f68-a66f-53ebe90f6ac2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:42.969970 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a3c8c6f0-1dd7-4f68-a66f-53ebe90f6ac2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:42.978184 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a3c8c6f0-1dd7-4f68-a66f-53ebe90f6ac2 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1508 microversion: 2.1 time: 0.163580 Aug 31 11:10:42.978742 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 327/705] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:42 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:43.068685 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:10:43.069173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:10:43.069804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:10:43.070249 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:10:43.070693 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:10:43.079650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:43.080287 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:43.081297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:43.082162 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:43.082611 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:43.083032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:43.102030 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:10:43.124279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Getting quotas for user d0e5dae087184c56b1cb72fb7705d4d5 and project 173d9af664764ba5bd694dab38d8bb6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:10:43.142728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:43.147855 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:10:43.153737 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:10:43.277284 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-63ae79da-5606-43f3-a0a5-34019a107579 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.186392 Aug 31 11:10:43.278245 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 379/706] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:10:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 11:10:43.291142 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1c45b0ef-e4c4-453c-8ad7-bc5e7c810e19 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:43.292112 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-1c45b0ef-e4c4-453c-8ad7-bc5e7c810e19 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:43.379940 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-1c45b0ef-e4c4-453c-8ad7-bc5e7c810e19 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:43.387450 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-1c45b0ef-e4c4-453c-8ad7-bc5e7c810e19 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1241 microversion: 2.1 time: 0.100253 Aug 31 11:10:43.388719 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 328/707] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:43 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:43.999011 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fc8133a5-9c92-4159-8fdf-0dbb3751d1b7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:43.999746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fc8133a5-9c92-4159-8fdf-0dbb3751d1b7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:44.007054 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fc8133a5-9c92-4159-8fdf-0dbb3751d1b7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:44.007626 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fc8133a5-9c92-4159-8fdf-0dbb3751d1b7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:44.008169 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fc8133a5-9c92-4159-8fdf-0dbb3751d1b7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:44.008961 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fc8133a5-9c92-4159-8fdf-0dbb3751d1b7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:44.009523 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fc8133a5-9c92-4159-8fdf-0dbb3751d1b7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:44.010020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fc8133a5-9c92-4159-8fdf-0dbb3751d1b7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:44.141085 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fc8133a5-9c92-4159-8fdf-0dbb3751d1b7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:44.149298 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fc8133a5-9c92-4159-8fdf-0dbb3751d1b7 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1508 microversion: 2.1 time: 0.154354 Aug 31 11:10:44.149881 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 380/708] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:43 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:44.409785 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-de6e7573-f412-46b1-bd80-f1703b8624dc tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:44.410436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-de6e7573-f412-46b1-bd80-f1703b8624dc tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:44.418937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de6e7573-f412-46b1-bd80-f1703b8624dc tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:44.419450 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de6e7573-f412-46b1-bd80-f1703b8624dc tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:44.419956 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de6e7573-f412-46b1-bd80-f1703b8624dc tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:44.420693 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de6e7573-f412-46b1-bd80-f1703b8624dc tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:44.421150 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de6e7573-f412-46b1-bd80-f1703b8624dc tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:44.421597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de6e7573-f412-46b1-bd80-f1703b8624dc tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:44.676870 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-de6e7573-f412-46b1-bd80-f1703b8624dc tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:44.685141 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-de6e7573-f412-46b1-bd80-f1703b8624dc tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1245 microversion: 2.1 time: 0.280181 Aug 31 11:10:44.685715 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 329/709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:44 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1245 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:45.174205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d72988f8-b637-488b-a018-64459b768c67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:45.175448 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d72988f8-b637-488b-a018-64459b768c67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:45.182116 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d72988f8-b637-488b-a018-64459b768c67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:45.182914 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d72988f8-b637-488b-a018-64459b768c67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:45.183446 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d72988f8-b637-488b-a018-64459b768c67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:45.184258 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d72988f8-b637-488b-a018-64459b768c67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:45.184780 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d72988f8-b637-488b-a018-64459b768c67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:45.185279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d72988f8-b637-488b-a018-64459b768c67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:45.332166 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d72988f8-b637-488b-a018-64459b768c67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:45.345082 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d72988f8-b637-488b-a018-64459b768c67 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1508 microversion: 2.1 time: 0.176523 Aug 31 11:10:45.359859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 381/710] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:45 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:45.708050 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3e56b3f6-93ff-40b9-8d2d-4a6df9c0e314 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:45.708780 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3e56b3f6-93ff-40b9-8d2d-4a6df9c0e314 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:45.716649 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e56b3f6-93ff-40b9-8d2d-4a6df9c0e314 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:45.717469 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e56b3f6-93ff-40b9-8d2d-4a6df9c0e314 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:45.718237 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e56b3f6-93ff-40b9-8d2d-4a6df9c0e314 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:45.719202 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e56b3f6-93ff-40b9-8d2d-4a6df9c0e314 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:45.719801 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e56b3f6-93ff-40b9-8d2d-4a6df9c0e314 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:45.720395 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e56b3f6-93ff-40b9-8d2d-4a6df9c0e314 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:45.842414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3e56b3f6-93ff-40b9-8d2d-4a6df9c0e314 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:45.851346 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3e56b3f6-93ff-40b9-8d2d-4a6df9c0e314 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1311 microversion: 2.1 time: 0.147743 Aug 31 11:10:45.852085 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 330/711] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:45 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1311 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:46.041509 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-5015190a-a6ae-486e-85b6-a8225d30bd39 req-ae5e939e-9d4d-43b0-a0b9-5abee65a9aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef326a6-422d-46ab-8437-92751363027e", "name": "network-vif-deleted", "tag": "959bd8f8-d3e0-4f32-b288-fb014d4a28cd"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:46.057630 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-5015190a-a6ae-486e-85b6-a8225d30bd39 req-ae5e939e-9d4d-43b0-a0b9-5abee65a9aaf service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:46.061665 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-5015190a-a6ae-486e-85b6-a8225d30bd39 req-ae5e939e-9d4d-43b0-a0b9-5abee65a9aaf service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:46.062414 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-5015190a-a6ae-486e-85b6-a8225d30bd39 req-ae5e939e-9d4d-43b0-a0b9-5abee65a9aaf service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:46.078796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-5015190a-a6ae-486e-85b6-a8225d30bd39 req-ae5e939e-9d4d-43b0-a0b9-5abee65a9aaf service nova] Creating event network-vif-deleted:959bd8f8-d3e0-4f32-b288-fb014d4a28cd for instance 5ef326a6-422d-46ab-8437-92751363027e on hv-cinder-85535 Aug 31 11:10:46.118283 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-5015190a-a6ae-486e-85b6-a8225d30bd39 req-ae5e939e-9d4d-43b0-a0b9-5abee65a9aaf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080141 Aug 31 11:10:46.121612 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 382/712] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:46.368953 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:46.370205 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:46.378974 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:46.379953 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:46.380537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:46.381416 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:46.382298 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:46.383375 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:46.457187 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:46.458221 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:46.458960 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:46.459670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lazy-loading 'fault' on Instance uuid 5ef326a6-422d-46ab-8437-92751363027e {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:46.532620 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:46.543912 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-da6586b7-81a0-4f2c-95a9-3a229ef98d65 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 200 len: 1312 microversion: 2.1 time: 0.179611 Aug 31 11:10:46.558047 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 331/713] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:46 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:46.877108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1732ba4d-e889-4c1f-b891-4e051f9bce1c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:46.877108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1732ba4d-e889-4c1f-b891-4e051f9bce1c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:46.889766 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1732ba4d-e889-4c1f-b891-4e051f9bce1c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:46.890040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1732ba4d-e889-4c1f-b891-4e051f9bce1c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:46.890660 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1732ba4d-e889-4c1f-b891-4e051f9bce1c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:46.891532 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1732ba4d-e889-4c1f-b891-4e051f9bce1c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:46.897194 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1732ba4d-e889-4c1f-b891-4e051f9bce1c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:46.898024 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1732ba4d-e889-4c1f-b891-4e051f9bce1c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:47.227591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-1732ba4d-e889-4c1f-b891-4e051f9bce1c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:47.236045 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1732ba4d-e889-4c1f-b891-4e051f9bce1c tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1367 microversion: 2.1 time: 0.364645 Aug 31 11:10:47.237755 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 383/714] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:46 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1367 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:47.568890 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b83029fc-c7ce-4007-a1dd-2f01a1859e6e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:47.569508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b83029fc-c7ce-4007-a1dd-2f01a1859e6e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: 5ef326a6-422d-46ab-8437-92751363027e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:47.592319 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b83029fc-c7ce-4007-a1dd-2f01a1859e6e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:47.592813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b83029fc-c7ce-4007-a1dd-2f01a1859e6e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:47.593872 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b83029fc-c7ce-4007-a1dd-2f01a1859e6e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:47.594598 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b83029fc-c7ce-4007-a1dd-2f01a1859e6e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:47.595833 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b83029fc-c7ce-4007-a1dd-2f01a1859e6e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:47.596325 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b83029fc-c7ce-4007-a1dd-2f01a1859e6e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:47.625975 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-b83029fc-c7ce-4007-a1dd-2f01a1859e6e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] HTTP exception thrown: Instance 5ef326a6-422d-46ab-8437-92751363027e could not be found. Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b83029fc-c7ce-4007-a1dd-2f01a1859e6e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Request method failure captured: Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e HTTP/1.1 Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0B3pxnNtheXxMA108K-k3aets4iDu1xumVDmbwkNyulZyujoyRzznHgfG-H745bhKzmC_tincuwf2-1k2WKMJBp3v_5eKOI2HXs-BSvvXLY5ppaBAEot0sxP3oNxqcqTMTOtvZEHhj2BQuPOndfD2LNaMReJc2hJWcOZYGeTmQONow Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 9ceec51e430e4a00b407068a2243be63 Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:10:47.628736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:10:47.630359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ceec51e430e4a00b407068a2243be63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ceec51e430e4a00b407068a2243be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ceec51e430e4a00b407068a2243be63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ceec51e430e4a00b407068a2243be63"}]}] Aug 31 11:10:47.630359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:10:47.630359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 9ceec51e430e4a00b407068a2243be63 Aug 31 11:10:47.630359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:10:47.630359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-ServerRescueNegativeTestJSON-92711221-project Aug 31 11:10:47.630359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:10:47.630359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:10:47.630359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 19643be9952649aba81e61d5d55290c4 Aug 31 11:10:47.630359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-ServerRescueNegativeTestJSON-92711221-project Aug 31 11:10:47.630359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:10:47.630359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 5ef326a6-422d-46ab-8437-92751363027e could not be found. Aug 31 11:10:47.630359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '5ef326a6-422d-46ab-8437-92751363027e'} Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef326a6-422d-46ab-8437-92751363027e could not be found. Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:10:47.631302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef326a6-422d-46ab-8437-92751363027e could not be found. Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef326a6-422d-46ab-8437-92751363027e could not be found. Aug 31 11:10:47.632921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:10:47.635162 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b83029fc-c7ce-4007-a1dd-2f01a1859e6e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Returning 404 to user: Instance 5ef326a6-422d-46ab-8437-92751363027e could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:10:47.636279 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b83029fc-c7ce-4007-a1dd-2f01a1859e6e tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e" status: 404 len: 111 microversion: 2.1 time: 0.071790 Aug 31 11:10:47.636935 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 332/715] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:47 2022] GET /compute/v2.1/servers/5ef326a6-422d-46ab-8437-92751363027e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:10:47.648057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d3f9e712-3b23-45f3-9d5f-fc0b786269fe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:47.648703 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d3f9e712-3b23-45f3-9d5f-fc0b786269fe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:47.661285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3f9e712-3b23-45f3-9d5f-fc0b786269fe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:47.661813 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3f9e712-3b23-45f3-9d5f-fc0b786269fe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:47.662455 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3f9e712-3b23-45f3-9d5f-fc0b786269fe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:47.663331 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3f9e712-3b23-45f3-9d5f-fc0b786269fe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:47.663947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3f9e712-3b23-45f3-9d5f-fc0b786269fe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:47.664564 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d3f9e712-3b23-45f3-9d5f-fc0b786269fe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:47.706893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d3f9e712-3b23-45f3-9d5f-fc0b786269fe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:10:47.878909 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d3f9e712-3b23-45f3-9d5f-fc0b786269fe tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 204 len: 0 microversion: 2.1 time: 0.235242 Aug 31 11:10:47.882947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 384/716] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:10:47 2022] DELETE /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:10:47.889453 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-905dffbd-d65f-40ad-b0e2-0804c935943b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:47.890293 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-905dffbd-d65f-40ad-b0e2-0804c935943b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:47.899337 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-905dffbd-d65f-40ad-b0e2-0804c935943b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:47.900650 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-905dffbd-d65f-40ad-b0e2-0804c935943b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:47.901266 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-905dffbd-d65f-40ad-b0e2-0804c935943b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:47.902160 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-905dffbd-d65f-40ad-b0e2-0804c935943b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:47.902885 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-905dffbd-d65f-40ad-b0e2-0804c935943b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:47.903588 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-905dffbd-d65f-40ad-b0e2-0804c935943b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:48.073911 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-905dffbd-d65f-40ad-b0e2-0804c935943b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:48.085627 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-905dffbd-d65f-40ad-b0e2-0804c935943b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.199785 Aug 31 11:10:48.086288 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 333/717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:47 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:48.156827 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-aba2a4c4-1936-4961-adf6-c08088187401 req-b3dca9a4-f6bb-475d-99a7-76a23c69ca68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f28b6c6d-05e1-48fa-acee-b169de5dc6cb", "tag": "7bfcfade-8041-4e70-b6fd-dbe86a28ffdb"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:48.167512 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-aba2a4c4-1936-4961-adf6-c08088187401 req-b3dca9a4-f6bb-475d-99a7-76a23c69ca68 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:48.168057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-aba2a4c4-1936-4961-adf6-c08088187401 req-b3dca9a4-f6bb-475d-99a7-76a23c69ca68 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:48.168447 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-aba2a4c4-1936-4961-adf6-c08088187401 req-b3dca9a4-f6bb-475d-99a7-76a23c69ca68 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:48.180380 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-aba2a4c4-1936-4961-adf6-c08088187401 req-b3dca9a4-f6bb-475d-99a7-76a23c69ca68 service nova] Creating event network-changed:7bfcfade-8041-4e70-b6fd-dbe86a28ffdb for instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb on hv-cinder-85535 Aug 31 11:10:48.185048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-aba2a4c4-1936-4961-adf6-c08088187401 req-b3dca9a4-f6bb-475d-99a7-76a23c69ca68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032212 Aug 31 11:10:48.185641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 385/718] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:10:48.259248 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-096baf00-ae14-4bfd-a243-cb58893751f5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:48.259993 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-096baf00-ae14-4bfd-a243-cb58893751f5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:48.267195 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-096baf00-ae14-4bfd-a243-cb58893751f5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:48.267747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-096baf00-ae14-4bfd-a243-cb58893751f5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:48.268750 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-096baf00-ae14-4bfd-a243-cb58893751f5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:48.269444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-096baf00-ae14-4bfd-a243-cb58893751f5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:48.269916 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-096baf00-ae14-4bfd-a243-cb58893751f5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:48.270330 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-096baf00-ae14-4bfd-a243-cb58893751f5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:48.415569 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-096baf00-ae14-4bfd-a243-cb58893751f5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:48.423097 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-096baf00-ae14-4bfd-a243-cb58893751f5 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1367 microversion: 2.1 time: 0.167839 Aug 31 11:10:48.423649 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 334/719] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:48 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:49.107385 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e755e7ba-1b6e-4678-a3e4-811da7023813 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:49.109969 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e755e7ba-1b6e-4678-a3e4-811da7023813 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:49.117916 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e755e7ba-1b6e-4678-a3e4-811da7023813 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:49.118687 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e755e7ba-1b6e-4678-a3e4-811da7023813 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:49.119381 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e755e7ba-1b6e-4678-a3e4-811da7023813 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:49.120322 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e755e7ba-1b6e-4678-a3e4-811da7023813 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:49.120947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e755e7ba-1b6e-4678-a3e4-811da7023813 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:49.121517 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e755e7ba-1b6e-4678-a3e4-811da7023813 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:49.126744 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:49.276548 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e755e7ba-1b6e-4678-a3e4-811da7023813 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:49.284217 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e755e7ba-1b6e-4678-a3e4-811da7023813 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.181716 Aug 31 11:10:49.284794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 386/720] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:49 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:49.446766 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b36a4fbc-b305-48fb-8da0-3c07fa2dba29 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:49.447371 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b36a4fbc-b305-48fb-8da0-3c07fa2dba29 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:49.453772 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b36a4fbc-b305-48fb-8da0-3c07fa2dba29 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:49.454250 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b36a4fbc-b305-48fb-8da0-3c07fa2dba29 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:49.454681 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b36a4fbc-b305-48fb-8da0-3c07fa2dba29 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:49.455378 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b36a4fbc-b305-48fb-8da0-3c07fa2dba29 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:49.455821 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b36a4fbc-b305-48fb-8da0-3c07fa2dba29 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:49.456269 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b36a4fbc-b305-48fb-8da0-3c07fa2dba29 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:49.592058 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b36a4fbc-b305-48fb-8da0-3c07fa2dba29 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:49.603244 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b36a4fbc-b305-48fb-8da0-3c07fa2dba29 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1367 microversion: 2.1 time: 0.160426 Aug 31 11:10:49.608593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 335/721] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:49 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:50.305478 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-63e487c5-912a-4b06-af15-bfe99fddf871 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:50.306094 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-63e487c5-912a-4b06-af15-bfe99fddf871 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:50.312782 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63e487c5-912a-4b06-af15-bfe99fddf871 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:50.313271 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63e487c5-912a-4b06-af15-bfe99fddf871 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:50.313709 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63e487c5-912a-4b06-af15-bfe99fddf871 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:50.314938 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63e487c5-912a-4b06-af15-bfe99fddf871 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:50.315466 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63e487c5-912a-4b06-af15-bfe99fddf871 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:50.315895 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-63e487c5-912a-4b06-af15-bfe99fddf871 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:50.539185 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-63e487c5-912a-4b06-af15-bfe99fddf871 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:50.546996 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-63e487c5-912a-4b06-af15-bfe99fddf871 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.245500 Aug 31 11:10:50.547569 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 387/722] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:50 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:50.628516 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3f4531e6-50c9-42ba-a541-5bab42a5af41 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:50.629896 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3f4531e6-50c9-42ba-a541-5bab42a5af41 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:50.637015 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f4531e6-50c9-42ba-a541-5bab42a5af41 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:50.637964 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f4531e6-50c9-42ba-a541-5bab42a5af41 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:50.638776 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f4531e6-50c9-42ba-a541-5bab42a5af41 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:50.639799 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f4531e6-50c9-42ba-a541-5bab42a5af41 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:50.641379 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f4531e6-50c9-42ba-a541-5bab42a5af41 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:50.642096 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3f4531e6-50c9-42ba-a541-5bab42a5af41 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:50.840943 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3f4531e6-50c9-42ba-a541-5bab42a5af41 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:50.844279 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:50.853419 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3f4531e6-50c9-42ba-a541-5bab42a5af41 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1367 microversion: 2.1 time: 0.230241 Aug 31 11:10:50.854277 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 336/723] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:50 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:51.567205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-90bc509a-ca8e-4eb8-ac41-d8812b86a6d0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:51.568469 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-90bc509a-ca8e-4eb8-ac41-d8812b86a6d0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:51.575915 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-90bc509a-ca8e-4eb8-ac41-d8812b86a6d0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:51.576443 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-90bc509a-ca8e-4eb8-ac41-d8812b86a6d0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:51.576880 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-90bc509a-ca8e-4eb8-ac41-d8812b86a6d0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:51.577591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-90bc509a-ca8e-4eb8-ac41-d8812b86a6d0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:51.578042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-90bc509a-ca8e-4eb8-ac41-d8812b86a6d0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:51.578467 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-90bc509a-ca8e-4eb8-ac41-d8812b86a6d0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:51.835222 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-90bc509a-ca8e-4eb8-ac41-d8812b86a6d0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:51.854833 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-90bc509a-ca8e-4eb8-ac41-d8812b86a6d0 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1520 microversion: 2.1 time: 0.291582 Aug 31 11:10:51.855572 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 388/724] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:51 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:51.874656 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-eb261963-bee0-49de-aa2a-c22a9709a63e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:51.876176 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-eb261963-bee0-49de-aa2a-c22a9709a63e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:51.893417 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eb261963-bee0-49de-aa2a-c22a9709a63e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:51.895641 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eb261963-bee0-49de-aa2a-c22a9709a63e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:51.896024 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eb261963-bee0-49de-aa2a-c22a9709a63e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:51.896762 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eb261963-bee0-49de-aa2a-c22a9709a63e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:51.897249 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eb261963-bee0-49de-aa2a-c22a9709a63e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:51.897641 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eb261963-bee0-49de-aa2a-c22a9709a63e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:52.117719 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-eb261963-bee0-49de-aa2a-c22a9709a63e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:52.129917 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-eb261963-bee0-49de-aa2a-c22a9709a63e tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1367 microversion: 2.1 time: 0.259151 Aug 31 11:10:52.131167 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 337/725] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:51 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:52.169776 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-fd7f9429-d78a-4124-9572-050c29e19a4c req-99741fe7-571c-48ef-9694-eed86ea066fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc9445a-04e3-40f8-a633-1a8cfa00c35e", "name": "network-vif-deleted", "tag": "06e3aac7-5227-4820-84b2-1723e967b4d6"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:52.180343 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-fd7f9429-d78a-4124-9572-050c29e19a4c req-99741fe7-571c-48ef-9694-eed86ea066fc service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:52.180820 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-fd7f9429-d78a-4124-9572-050c29e19a4c req-99741fe7-571c-48ef-9694-eed86ea066fc service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:52.181415 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-fd7f9429-d78a-4124-9572-050c29e19a4c req-99741fe7-571c-48ef-9694-eed86ea066fc service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:52.193482 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-fd7f9429-d78a-4124-9572-050c29e19a4c req-99741fe7-571c-48ef-9694-eed86ea066fc service nova] Creating event network-vif-deleted:06e3aac7-5227-4820-84b2-1723e967b4d6 for instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e on hv-cinder-85535 Aug 31 11:10:52.199210 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-fd7f9429-d78a-4124-9572-050c29e19a4c req-99741fe7-571c-48ef-9694-eed86ea066fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032936 Aug 31 11:10:52.200655 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 389/726] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:52.420076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c010fd1f-2221-404a-b667-f06f2c91e639 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:52.420858 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c010fd1f-2221-404a-b667-f06f2c91e639 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:52.436332 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c010fd1f-2221-404a-b667-f06f2c91e639 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:52.437184 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c010fd1f-2221-404a-b667-f06f2c91e639 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:52.437786 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c010fd1f-2221-404a-b667-f06f2c91e639 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:52.438835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c010fd1f-2221-404a-b667-f06f2c91e639 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:52.440328 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c010fd1f-2221-404a-b667-f06f2c91e639 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:52.441173 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c010fd1f-2221-404a-b667-f06f2c91e639 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:52.471586 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c010fd1f-2221-404a-b667-f06f2c91e639 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/ips" status: 200 len: 152 microversion: 2.20 time: 0.277227 Aug 31 11:10:52.472193 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 338/727] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Aug 31 11:10:52 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/ips => generated 152 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 11:10:52.878138 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:52.878893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:52.903269 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:52.909163 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:52.909891 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:52.915322 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:52.915886 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:52.918305 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:53.072158 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:53.073091 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:53.073812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:53.075241 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lazy-loading 'fault' on Instance uuid fdc9445a-04e3-40f8-a633-1a8cfa00c35e {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:53.094168 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:53.134282 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=6 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:53.157330 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7257b628-b3bd-414d-84e7-b155e6550a14 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:53.159469 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-7257b628-b3bd-414d-84e7-b155e6550a14 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:53.174004 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7257b628-b3bd-414d-84e7-b155e6550a14 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:53.174954 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7257b628-b3bd-414d-84e7-b155e6550a14 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:53.175646 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7257b628-b3bd-414d-84e7-b155e6550a14 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:53.177357 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7257b628-b3bd-414d-84e7-b155e6550a14 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:53.178810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7257b628-b3bd-414d-84e7-b155e6550a14 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:53.180181 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7257b628-b3bd-414d-84e7-b155e6550a14 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:53.307021 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19643be9952649aba81e61d5d55290c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceec51e430e4a00b407068a2243be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:53.318076 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-94812f26-d479-44cb-b402-575f0043ee7b tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 200 len: 1311 microversion: 2.1 time: 0.444772 Aug 31 11:10:53.332358 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 390/728] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:52 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 1311 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:53.384849 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=6 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:10:53.590223 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7257b628-b3bd-414d-84e7-b155e6550a14 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:53.613876 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7257b628-b3bd-414d-84e7-b155e6550a14 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1367 microversion: 2.1 time: 0.450244 Aug 31 11:10:53.614721 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 339/729] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:53 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:54.372259 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6c03b54b-5988-4e47-9b31-be61c4bcb909 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:54.373041 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6c03b54b-5988-4e47-9b31-be61c4bcb909 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] [instance: fdc9445a-04e3-40f8-a633-1a8cfa00c35e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:54.381262 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6c03b54b-5988-4e47-9b31-be61c4bcb909 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:54.381778 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6c03b54b-5988-4e47-9b31-be61c4bcb909 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:54.382425 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6c03b54b-5988-4e47-9b31-be61c4bcb909 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:54.383295 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6c03b54b-5988-4e47-9b31-be61c4bcb909 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:54.383753 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6c03b54b-5988-4e47-9b31-be61c4bcb909 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:54.384205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6c03b54b-5988-4e47-9b31-be61c4bcb909 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:54.400076 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-6c03b54b-5988-4e47-9b31-be61c4bcb909 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] HTTP exception thrown: Instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e could not be found. Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6c03b54b-5988-4e47-9b31-be61c4bcb909 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Request method failure captured: Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e HTTP/1.1 Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0B3pxnNtheXxMA108K-k3aets4iDu1xumVDmbwkNyulZyujoyRzznHgfG-H745bhKzmC_tincuwf2-1k2WKMJBp3v_5eKOI2HXs-BSvvXLY5ppaBAEot0sxP3oNxqcqTMTOtvZEHhj2BQuPOndfD2LNaMReJc2hJWcOZYGeTmQONow Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 9ceec51e430e4a00b407068a2243be63 Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:10:54.402156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:10:54.403728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ceec51e430e4a00b407068a2243be63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ceec51e430e4a00b407068a2243be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ceec51e430e4a00b407068a2243be63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ceec51e430e4a00b407068a2243be63"}]}] Aug 31 11:10:54.403728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:10:54.403728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 9ceec51e430e4a00b407068a2243be63 Aug 31 11:10:54.403728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-92711221 Aug 31 11:10:54.403728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-ServerRescueNegativeTestJSON-92711221-project Aug 31 11:10:54.403728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:10:54.403728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:10:54.403728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 19643be9952649aba81e61d5d55290c4 Aug 31 11:10:54.403728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-ServerRescueNegativeTestJSON-92711221-project Aug 31 11:10:54.403728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:10:54.403728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e could not be found. Aug 31 11:10:54.403728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': 'fdc9445a-04e3-40f8-a633-1a8cfa00c35e'} Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e could not be found. Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:10:54.404561 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e could not be found. Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e could not be found. Aug 31 11:10:54.405769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:10:54.406815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6c03b54b-5988-4e47-9b31-be61c4bcb909 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] Returning 404 to user: Instance fdc9445a-04e3-40f8-a633-1a8cfa00c35e could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:10:54.406815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6c03b54b-5988-4e47-9b31-be61c4bcb909 tempest-ServerRescueNegativeTestJSON-92711221 tempest-ServerRescueNegativeTestJSON-92711221-project] 10.222.0.20 "GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e" status: 404 len: 111 microversion: 2.1 time: 0.050004 Aug 31 11:10:54.406815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 391/730] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:54 2022] GET /compute/v2.1/servers/fdc9445a-04e3-40f8-a633-1a8cfa00c35e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:10:54.638823 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5554264f-7109-4d1f-ba36-0b68f0df0f24 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:54.639541 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-5554264f-7109-4d1f-ba36-0b68f0df0f24 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:54.647402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5554264f-7109-4d1f-ba36-0b68f0df0f24 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:54.648215 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5554264f-7109-4d1f-ba36-0b68f0df0f24 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:54.648828 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5554264f-7109-4d1f-ba36-0b68f0df0f24 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:54.649701 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5554264f-7109-4d1f-ba36-0b68f0df0f24 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:54.650322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5554264f-7109-4d1f-ba36-0b68f0df0f24 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:54.650907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5554264f-7109-4d1f-ba36-0b68f0df0f24 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:54.696057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2f5da807-4100-4e79-a678-aff42c310bc8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:54.696588 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2f5da807-4100-4e79-a678-aff42c310bc8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:54.708107 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2f5da807-4100-4e79-a678-aff42c310bc8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:54.708767 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2f5da807-4100-4e79-a678-aff42c310bc8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:54.709409 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2f5da807-4100-4e79-a678-aff42c310bc8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:54.710242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2f5da807-4100-4e79-a678-aff42c310bc8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:54.710818 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2f5da807-4100-4e79-a678-aff42c310bc8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:54.711357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2f5da807-4100-4e79-a678-aff42c310bc8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:54.761936 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-2f5da807-4100-4e79-a678-aff42c310bc8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lazy-loading 'flavor' on Instance uuid 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:55.081233 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2f5da807-4100-4e79-a678-aff42c310bc8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "POST /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/action" status: 202 len: 0 microversion: 2.20 time: 0.388009 Aug 31 11:10:55.082380 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 392/731] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 31 11:10:54 2022] POST /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:10:55.109081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-99ba978c-e9f2-4b59-a15a-4559b66962e8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:55.110829 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-99ba978c-e9f2-4b59-a15a-4559b66962e8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:55.119009 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-99ba978c-e9f2-4b59-a15a-4559b66962e8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:55.119420 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-99ba978c-e9f2-4b59-a15a-4559b66962e8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:55.120676 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-99ba978c-e9f2-4b59-a15a-4559b66962e8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:55.121624 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-99ba978c-e9f2-4b59-a15a-4559b66962e8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:55.123092 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-99ba978c-e9f2-4b59-a15a-4559b66962e8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:55.123780 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-99ba978c-e9f2-4b59-a15a-4559b66962e8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:55.145601 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5554264f-7109-4d1f-ba36-0b68f0df0f24 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:55.163040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-5554264f-7109-4d1f-ba36-0b68f0df0f24 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1367 microversion: 2.1 time: 0.527995 Aug 31 11:10:55.170153 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 340/732] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:54 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1367 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:55.370712 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-99ba978c-e9f2-4b59-a15a-4559b66962e8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:55.384455 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-99ba978c-e9f2-4b59-a15a-4559b66962e8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:55.386017 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-99ba978c-e9f2-4b59-a15a-4559b66962e8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:55.387485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-99ba978c-e9f2-4b59-a15a-4559b66962e8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1723 microversion: 2.20 time: 0.291606 Aug 31 11:10:55.389999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 393/733] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:10:55 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:10:56.135965 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7fa5fb3f-de46-4644-899d-c57cff7d67cf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:56.137340 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-7fa5fb3f-de46-4644-899d-c57cff7d67cf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:56.145496 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fa5fb3f-de46-4644-899d-c57cff7d67cf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:56.146098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fa5fb3f-de46-4644-899d-c57cff7d67cf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:56.146778 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fa5fb3f-de46-4644-899d-c57cff7d67cf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:56.147699 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fa5fb3f-de46-4644-899d-c57cff7d67cf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:56.148372 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fa5fb3f-de46-4644-899d-c57cff7d67cf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:56.148892 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fa5fb3f-de46-4644-899d-c57cff7d67cf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:56.175404 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-7fa5fb3f-de46-4644-899d-c57cff7d67cf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lazy-loading 'flavor' on Instance uuid dd2a8d50-fa16-40f4-9760-25603efd4d6d {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:10:56.201654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1945b461-6c06-47ec-a9a0-f4cb11c7bda0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:56.202426 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1945b461-6c06-47ec-a9a0-f4cb11c7bda0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:56.212371 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1945b461-6c06-47ec-a9a0-f4cb11c7bda0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:56.213320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1945b461-6c06-47ec-a9a0-f4cb11c7bda0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:56.213944 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1945b461-6c06-47ec-a9a0-f4cb11c7bda0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:56.214836 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1945b461-6c06-47ec-a9a0-f4cb11c7bda0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:56.215470 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1945b461-6c06-47ec-a9a0-f4cb11c7bda0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:56.216089 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1945b461-6c06-47ec-a9a0-f4cb11c7bda0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:56.276907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7fa5fb3f-de46-4644-899d-c57cff7d67cf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "POST /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d/action" status: 202 len: 0 microversion: 2.1 time: 0.144811 Aug 31 11:10:56.278473 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 341/734] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:10:56 2022] POST /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:10:56.305810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8331e3ef-6851-4860-ac6b-cac96cbafd45 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:56.307136 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8331e3ef-6851-4860-ac6b-cac96cbafd45 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:56.318290 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8331e3ef-6851-4860-ac6b-cac96cbafd45 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:56.319149 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8331e3ef-6851-4860-ac6b-cac96cbafd45 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:56.319779 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8331e3ef-6851-4860-ac6b-cac96cbafd45 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:56.320763 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8331e3ef-6851-4860-ac6b-cac96cbafd45 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:56.321680 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8331e3ef-6851-4860-ac6b-cac96cbafd45 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:56.322373 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8331e3ef-6851-4860-ac6b-cac96cbafd45 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:56.387990 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-1945b461-6c06-47ec-a9a0-f4cb11c7bda0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:56.397486 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1945b461-6c06-47ec-a9a0-f4cb11c7bda0 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1367 microversion: 2.1 time: 0.205085 Aug 31 11:10:56.398400 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 394/735] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:56 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:56.414375 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9a76de8d-5d4c-4c01-a90f-c1f619d341a5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:56.415014 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9a76de8d-5d4c-4c01-a90f-c1f619d341a5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:56.421123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9a76de8d-5d4c-4c01-a90f-c1f619d341a5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:56.421607 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9a76de8d-5d4c-4c01-a90f-c1f619d341a5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:56.422247 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9a76de8d-5d4c-4c01-a90f-c1f619d341a5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:56.423111 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9a76de8d-5d4c-4c01-a90f-c1f619d341a5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:56.424359 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9a76de8d-5d4c-4c01-a90f-c1f619d341a5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:56.425583 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9a76de8d-5d4c-4c01-a90f-c1f619d341a5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:56.566715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9a76de8d-5d4c-4c01-a90f-c1f619d341a5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:56.576065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9a76de8d-5d4c-4c01-a90f-c1f619d341a5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:56.578759 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9a76de8d-5d4c-4c01-a90f-c1f619d341a5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:56.581027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9a76de8d-5d4c-4c01-a90f-c1f619d341a5 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1723 microversion: 2.20 time: 0.171033 Aug 31 11:10:56.582636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 395/736] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:10:56 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:10:56.653192 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8331e3ef-6851-4860-ac6b-cac96cbafd45 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:56.667890 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8331e3ef-6851-4860-ac6b-cac96cbafd45 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.384180 Aug 31 11:10:56.669932 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 342/737] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:56 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:10:57.086878 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-28145b96-a988-44f8-aa52-0ea7bc883a9b req-7c6af772-a6ce-480a-921c-a1d7e4706ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28b6c6d-05e1-48fa-acee-b169de5dc6cb", "name": "network-vif-plugged", "status": "completed", "tag": "7bfcfade-8041-4e70-b6fd-dbe86a28ffdb"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:10:57.097175 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-28145b96-a988-44f8-aa52-0ea7bc883a9b req-7c6af772-a6ce-480a-921c-a1d7e4706ea5 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:57.097757 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-28145b96-a988-44f8-aa52-0ea7bc883a9b req-7c6af772-a6ce-480a-921c-a1d7e4706ea5 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:57.098012 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-28145b96-a988-44f8-aa52-0ea7bc883a9b req-7c6af772-a6ce-480a-921c-a1d7e4706ea5 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:57.112313 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-28145b96-a988-44f8-aa52-0ea7bc883a9b req-7c6af772-a6ce-480a-921c-a1d7e4706ea5 service nova] Creating event network-vif-plugged:7bfcfade-8041-4e70-b6fd-dbe86a28ffdb for instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb on hv-cinder-85535 Aug 31 11:10:57.118803 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-28145b96-a988-44f8-aa52-0ea7bc883a9b req-7c6af772-a6ce-480a-921c-a1d7e4706ea5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035244 Aug 31 11:10:57.120764 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 396/738] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:10:57.419994 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3a23152c-310f-419f-ad07-47ee775e4768 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:57.420666 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3a23152c-310f-419f-ad07-47ee775e4768 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:57.432824 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3a23152c-310f-419f-ad07-47ee775e4768 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:57.433328 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3a23152c-310f-419f-ad07-47ee775e4768 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:57.435616 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3a23152c-310f-419f-ad07-47ee775e4768 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:57.438809 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3a23152c-310f-419f-ad07-47ee775e4768 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:57.439453 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3a23152c-310f-419f-ad07-47ee775e4768 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:57.439901 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3a23152c-310f-419f-ad07-47ee775e4768 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:57.611938 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b706426f-2adf-49be-9d9c-96f8a84f5a6f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:57.612710 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b706426f-2adf-49be-9d9c-96f8a84f5a6f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:57.646706 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b706426f-2adf-49be-9d9c-96f8a84f5a6f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:57.648825 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b706426f-2adf-49be-9d9c-96f8a84f5a6f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:57.650712 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b706426f-2adf-49be-9d9c-96f8a84f5a6f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:57.652422 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b706426f-2adf-49be-9d9c-96f8a84f5a6f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:57.659523 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b706426f-2adf-49be-9d9c-96f8a84f5a6f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:57.660767 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b706426f-2adf-49be-9d9c-96f8a84f5a6f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:57.784863 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3a23152c-310f-419f-ad07-47ee775e4768 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:57.797186 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3a23152c-310f-419f-ad07-47ee775e4768 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1367 microversion: 2.1 time: 0.381095 Aug 31 11:10:57.799194 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 343/739] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:57 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:57.807674 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d83d23bb-e57d-4ebd-8af2-948f30602890 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:57.808687 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d83d23bb-e57d-4ebd-8af2-948f30602890 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:57.815807 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d83d23bb-e57d-4ebd-8af2-948f30602890 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:57.817105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d83d23bb-e57d-4ebd-8af2-948f30602890 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:57.817793 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d83d23bb-e57d-4ebd-8af2-948f30602890 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:57.818758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d83d23bb-e57d-4ebd-8af2-948f30602890 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:57.819437 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d83d23bb-e57d-4ebd-8af2-948f30602890 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:57.820137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d83d23bb-e57d-4ebd-8af2-948f30602890 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:58.027090 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b706426f-2adf-49be-9d9c-96f8a84f5a6f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:58.039819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b706426f-2adf-49be-9d9c-96f8a84f5a6f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:58.042372 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b706426f-2adf-49be-9d9c-96f8a84f5a6f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:58.044723 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b706426f-2adf-49be-9d9c-96f8a84f5a6f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1723 microversion: 2.20 time: 0.442708 Aug 31 11:10:58.050748 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 397/740] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:10:57 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1723 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:10:58.474876 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d83d23bb-e57d-4ebd-8af2-948f30602890 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:58.490355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d83d23bb-e57d-4ebd-8af2-948f30602890 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.687513 Aug 31 11:10:58.492612 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 344/741] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:57 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:58.819285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2705c2d4-f7b7-4e16-9cd9-f4c76af625b8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:58.819897 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2705c2d4-f7b7-4e16-9cd9-f4c76af625b8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:58.834677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2705c2d4-f7b7-4e16-9cd9-f4c76af625b8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:58.835901 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2705c2d4-f7b7-4e16-9cd9-f4c76af625b8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:58.839156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2705c2d4-f7b7-4e16-9cd9-f4c76af625b8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:58.841261 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2705c2d4-f7b7-4e16-9cd9-f4c76af625b8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:58.843961 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2705c2d4-f7b7-4e16-9cd9-f4c76af625b8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:58.846869 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2705c2d4-f7b7-4e16-9cd9-f4c76af625b8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:59.094236 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a17e6fce-9a0c-4781-a2e8-8cfe68b08057 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:59.094826 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a17e6fce-9a0c-4781-a2e8-8cfe68b08057 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:59.119897 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a17e6fce-9a0c-4781-a2e8-8cfe68b08057 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:59.120943 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a17e6fce-9a0c-4781-a2e8-8cfe68b08057 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:59.121799 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a17e6fce-9a0c-4781-a2e8-8cfe68b08057 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:59.122694 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a17e6fce-9a0c-4781-a2e8-8cfe68b08057 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:59.125279 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a17e6fce-9a0c-4781-a2e8-8cfe68b08057 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:59.133423 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a17e6fce-9a0c-4781-a2e8-8cfe68b08057 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:59.302022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2705c2d4-f7b7-4e16-9cd9-f4c76af625b8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:59.321508 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2705c2d4-f7b7-4e16-9cd9-f4c76af625b8 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1367 microversion: 2.1 time: 0.506439 Aug 31 11:10:59.326000 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 398/742] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:58 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1367 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:10:59.513966 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8f94e194-a73c-417f-9c16-18f0bef3504e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:10:59.514995 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8f94e194-a73c-417f-9c16-18f0bef3504e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:10:59.524815 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a17e6fce-9a0c-4781-a2e8-8cfe68b08057 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:59.526807 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8f94e194-a73c-417f-9c16-18f0bef3504e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:59.527553 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8f94e194-a73c-417f-9c16-18f0bef3504e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:59.528845 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8f94e194-a73c-417f-9c16-18f0bef3504e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:59.530275 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8f94e194-a73c-417f-9c16-18f0bef3504e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:10:59.533587 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a17e6fce-9a0c-4781-a2e8-8cfe68b08057 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:59.534727 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8f94e194-a73c-417f-9c16-18f0bef3504e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:10:59.535369 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a17e6fce-9a0c-4781-a2e8-8cfe68b08057 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:59.535892 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8f94e194-a73c-417f-9c16-18f0bef3504e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:10:59.549605 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a17e6fce-9a0c-4781-a2e8-8cfe68b08057 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1723 microversion: 2.20 time: 0.474189 Aug 31 11:10:59.568803 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 345/743] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:10:59 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1723 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:10:59.843345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8f94e194-a73c-417f-9c16-18f0bef3504e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:10:59.855469 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8f94e194-a73c-417f-9c16-18f0bef3504e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.344915 Aug 31 11:10:59.857203 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 399/744] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:10:59 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:00.349943 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-27a1362a-0a1f-47d6-bba6-991eba1acc48 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:00.350563 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-27a1362a-0a1f-47d6-bba6-991eba1acc48 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:00.359669 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-27a1362a-0a1f-47d6-bba6-991eba1acc48 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:00.360254 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-27a1362a-0a1f-47d6-bba6-991eba1acc48 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:00.360824 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-27a1362a-0a1f-47d6-bba6-991eba1acc48 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:00.365023 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-27a1362a-0a1f-47d6-bba6-991eba1acc48 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:00.372856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-27a1362a-0a1f-47d6-bba6-991eba1acc48 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:00.373673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-27a1362a-0a1f-47d6-bba6-991eba1acc48 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:00.591697 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0878d1ee-0e04-4f52-8e8b-b3e02ceddb15 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:00.592898 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-0878d1ee-0e04-4f52-8e8b-b3e02ceddb15 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:00.627069 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0878d1ee-0e04-4f52-8e8b-b3e02ceddb15 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:00.627480 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0878d1ee-0e04-4f52-8e8b-b3e02ceddb15 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:00.627935 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0878d1ee-0e04-4f52-8e8b-b3e02ceddb15 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:00.630129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0878d1ee-0e04-4f52-8e8b-b3e02ceddb15 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:00.630613 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0878d1ee-0e04-4f52-8e8b-b3e02ceddb15 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:00.631053 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0878d1ee-0e04-4f52-8e8b-b3e02ceddb15 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:00.848639 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-27a1362a-0a1f-47d6-bba6-991eba1acc48 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:00.863551 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-27a1362a-0a1f-47d6-bba6-991eba1acc48 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1555 microversion: 2.1 time: 0.517523 Aug 31 11:11:00.867961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 346/745] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:00 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1555 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:00.879589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-34cde5dd-3cea-4979-88fe-22552f62a771 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:00.880314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-34cde5dd-3cea-4979-88fe-22552f62a771 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:00.885213 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0878d1ee-0e04-4f52-8e8b-b3e02ceddb15 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:00.891836 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-34cde5dd-3cea-4979-88fe-22552f62a771 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:00.892832 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-34cde5dd-3cea-4979-88fe-22552f62a771 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:00.894869 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0878d1ee-0e04-4f52-8e8b-b3e02ceddb15 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:00.895725 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-34cde5dd-3cea-4979-88fe-22552f62a771 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:00.897125 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0878d1ee-0e04-4f52-8e8b-b3e02ceddb15 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:00.899210 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0878d1ee-0e04-4f52-8e8b-b3e02ceddb15 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1723 microversion: 2.20 time: 0.311980 Aug 31 11:11:00.900257 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 400/746] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:00 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:11:00.900765 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-34cde5dd-3cea-4979-88fe-22552f62a771 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:00.901557 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-34cde5dd-3cea-4979-88fe-22552f62a771 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:00.903539 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-34cde5dd-3cea-4979-88fe-22552f62a771 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:00.906884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-43e16bfb-44d2-48b5-aad4-8eb9c876e8bd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:00.908457 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-43e16bfb-44d2-48b5-aad4-8eb9c876e8bd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:00.928504 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-43e16bfb-44d2-48b5-aad4-8eb9c876e8bd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:00.929369 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-43e16bfb-44d2-48b5-aad4-8eb9c876e8bd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:00.929997 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-43e16bfb-44d2-48b5-aad4-8eb9c876e8bd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:00.931252 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-43e16bfb-44d2-48b5-aad4-8eb9c876e8bd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:00.932365 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-43e16bfb-44d2-48b5-aad4-8eb9c876e8bd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:00.933731 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-43e16bfb-44d2-48b5-aad4-8eb9c876e8bd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:01.043408 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-43e16bfb-44d2-48b5-aad4-8eb9c876e8bd tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141423 Aug 31 11:11:01.044045 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 401/747] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 11:11:00 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:11:01.344176 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-34cde5dd-3cea-4979-88fe-22552f62a771 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:01.370781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-34cde5dd-3cea-4979-88fe-22552f62a771 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.488981 Aug 31 11:11:01.378635 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 347/748] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:00 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:01.930593 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7ccae3c4-315d-44c3-b931-7320709a225b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:01.933577 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7ccae3c4-315d-44c3-b931-7320709a225b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:01.947374 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7ccae3c4-315d-44c3-b931-7320709a225b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:01.948388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7ccae3c4-315d-44c3-b931-7320709a225b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:01.949863 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7ccae3c4-315d-44c3-b931-7320709a225b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:01.951688 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7ccae3c4-315d-44c3-b931-7320709a225b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:01.952368 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7ccae3c4-315d-44c3-b931-7320709a225b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:01.953881 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7ccae3c4-315d-44c3-b931-7320709a225b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:02.199497 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7ccae3c4-315d-44c3-b931-7320709a225b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:02.205229 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:02.216726 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7ccae3c4-315d-44c3-b931-7320709a225b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:02.218019 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7ccae3c4-315d-44c3-b931-7320709a225b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:02.219225 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7ccae3c4-315d-44c3-b931-7320709a225b tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1723 microversion: 2.20 time: 0.297587 Aug 31 11:11:02.220943 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 402/749] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:01 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:02.393566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b9cb5ea9-6cea-4cd8-8cae-d36a79074280 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:02.395111 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b9cb5ea9-6cea-4cd8-8cae-d36a79074280 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:02.414264 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b9cb5ea9-6cea-4cd8-8cae-d36a79074280 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:02.416195 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b9cb5ea9-6cea-4cd8-8cae-d36a79074280 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:02.420677 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b9cb5ea9-6cea-4cd8-8cae-d36a79074280 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:02.421646 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b9cb5ea9-6cea-4cd8-8cae-d36a79074280 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:02.422406 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b9cb5ea9-6cea-4cd8-8cae-d36a79074280 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:02.423360 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b9cb5ea9-6cea-4cd8-8cae-d36a79074280 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:03.106443 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b9cb5ea9-6cea-4cd8-8cae-d36a79074280 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:03.120287 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b9cb5ea9-6cea-4cd8-8cae-d36a79074280 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.733722 Aug 31 11:11:03.121745 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 348/750] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:02 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:03.245082 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-17b4348c-694e-4aa0-a915-8e1da5f67dab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:03.245696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-17b4348c-694e-4aa0-a915-8e1da5f67dab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:03.262003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17b4348c-694e-4aa0-a915-8e1da5f67dab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:03.262519 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17b4348c-694e-4aa0-a915-8e1da5f67dab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:03.264632 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17b4348c-694e-4aa0-a915-8e1da5f67dab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:03.265603 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17b4348c-694e-4aa0-a915-8e1da5f67dab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:03.266161 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17b4348c-694e-4aa0-a915-8e1da5f67dab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:03.266679 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-17b4348c-694e-4aa0-a915-8e1da5f67dab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:03.590941 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-17b4348c-694e-4aa0-a915-8e1da5f67dab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:03.599888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-17b4348c-694e-4aa0-a915-8e1da5f67dab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:03.602663 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-17b4348c-694e-4aa0-a915-8e1da5f67dab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:03.605337 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-17b4348c-694e-4aa0-a915-8e1da5f67dab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1723 microversion: 2.20 time: 0.365569 Aug 31 11:11:03.614329 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 403/751] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:03 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1723 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:03.902847 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-b6990359-97f9-496b-b881-9ee12bcd5f6b req-f43a888d-6775-4189-909f-553a59a10dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f28b6c6d-05e1-48fa-acee-b169de5dc6cb", "tag": "7bfcfade-8041-4e70-b6fd-dbe86a28ffdb"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:03.943787 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-b6990359-97f9-496b-b881-9ee12bcd5f6b req-f43a888d-6775-4189-909f-553a59a10dc1 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:03.945461 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-b6990359-97f9-496b-b881-9ee12bcd5f6b req-f43a888d-6775-4189-909f-553a59a10dc1 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:03.956811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-b6990359-97f9-496b-b881-9ee12bcd5f6b req-f43a888d-6775-4189-909f-553a59a10dc1 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:03.998255 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-b6990359-97f9-496b-b881-9ee12bcd5f6b req-f43a888d-6775-4189-909f-553a59a10dc1 service nova] Creating event network-changed:7bfcfade-8041-4e70-b6fd-dbe86a28ffdb for instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb on hv-cinder-85535 Aug 31 11:11:04.022578 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-b6990359-97f9-496b-b881-9ee12bcd5f6b req-f43a888d-6775-4189-909f-553a59a10dc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.444970 Aug 31 11:11:04.024793 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 349/752] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:11:04.144210 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-48180b0f-3c5d-4fab-9ca1-8d701cabdd72 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:04.149944 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-48180b0f-3c5d-4fab-9ca1-8d701cabdd72 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:04.164156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-48180b0f-3c5d-4fab-9ca1-8d701cabdd72 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:04.164958 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-48180b0f-3c5d-4fab-9ca1-8d701cabdd72 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:04.167402 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-48180b0f-3c5d-4fab-9ca1-8d701cabdd72 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:04.168500 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-48180b0f-3c5d-4fab-9ca1-8d701cabdd72 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:04.172260 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-48180b0f-3c5d-4fab-9ca1-8d701cabdd72 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:04.173769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-48180b0f-3c5d-4fab-9ca1-8d701cabdd72 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:04.482547 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-48180b0f-3c5d-4fab-9ca1-8d701cabdd72 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:04.507204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-48180b0f-3c5d-4fab-9ca1-8d701cabdd72 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.368031 Aug 31 11:11:04.511131 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 404/753] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:04 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:04.643808 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a824039a-c849-487d-b008-6ec4ce54df0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:04.644542 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a824039a-c849-487d-b008-6ec4ce54df0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:04.652513 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a824039a-c849-487d-b008-6ec4ce54df0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:04.653570 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a824039a-c849-487d-b008-6ec4ce54df0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:04.653570 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a824039a-c849-487d-b008-6ec4ce54df0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:04.654120 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a824039a-c849-487d-b008-6ec4ce54df0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:04.654652 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a824039a-c849-487d-b008-6ec4ce54df0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:04.654988 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a824039a-c849-487d-b008-6ec4ce54df0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:04.992419 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a824039a-c849-487d-b008-6ec4ce54df0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:05.007354 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a824039a-c849-487d-b008-6ec4ce54df0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:05.009262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a824039a-c849-487d-b008-6ec4ce54df0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:05.012324 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a824039a-c849-487d-b008-6ec4ce54df0d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1723 microversion: 2.20 time: 0.373077 Aug 31 11:11:05.029035 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 350/754] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:04 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1723 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:05.299184 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ac096153-0c76-459d-a3d9-d4bd91832267 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Action: 'create', calling method: .version_select at 0x7f732d1708b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1158123877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhGIbg6bU6pDd5PN7djd8fac10J33JDy5NzGKcd/U6pkSfoHeVHRm3Cw1Z0IeicZ4/WbK3LIS8EL6vl/q0Po+kByz9kOGNDP/4XPeNjFYEqPrAAcEkPINRgu2OAPsDFCg=="}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:05.316596 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-ac096153-0c76-459d-a3d9-d4bd91832267 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Getting quotas for project da5b36cb688f49e1bf1cf75a108858fa. Resources: {'key_pairs'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:11:05.320601 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-ac096153-0c76-459d-a3d9-d4bd91832267 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Getting quotas for user 16696c34de254f3babf538c879f2ce49 and project da5b36cb688f49e1bf1cf75a108858fa. Resources: {'key_pairs'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:11:05.347217 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ac096153-0c76-459d-a3d9-d4bd91832267 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.262791 Aug 31 11:11:05.352624 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 405/755] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 11:11:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:11:05.534511 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6d5689e4-9906-4af9-8636-fa779ff66e3a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:05.535719 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6d5689e4-9906-4af9-8636-fa779ff66e3a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:05.537797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:05.543178 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6d5689e4-9906-4af9-8636-fa779ff66e3a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:05.543761 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6d5689e4-9906-4af9-8636-fa779ff66e3a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:05.544865 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6d5689e4-9906-4af9-8636-fa779ff66e3a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:05.545786 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6d5689e4-9906-4af9-8636-fa779ff66e3a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:05.546448 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6d5689e4-9906-4af9-8636-fa779ff66e3a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:05.547077 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6d5689e4-9906-4af9-8636-fa779ff66e3a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:05.765476 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6d5689e4-9906-4af9-8636-fa779ff66e3a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:05.776325 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6d5689e4-9906-4af9-8636-fa779ff66e3a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.246762 Aug 31 11:11:05.792527 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 351/756] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:05 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:06.042655 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6d1bfa90-7c7e-429b-bab1-5baa3f9a47a9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:06.043765 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6d1bfa90-7c7e-429b-bab1-5baa3f9a47a9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:06.059300 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d1bfa90-7c7e-429b-bab1-5baa3f9a47a9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:06.060225 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d1bfa90-7c7e-429b-bab1-5baa3f9a47a9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:06.060911 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d1bfa90-7c7e-429b-bab1-5baa3f9a47a9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:06.061908 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d1bfa90-7c7e-429b-bab1-5baa3f9a47a9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:06.062583 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d1bfa90-7c7e-429b-bab1-5baa3f9a47a9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:06.063585 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d1bfa90-7c7e-429b-bab1-5baa3f9a47a9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:06.281391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6d1bfa90-7c7e-429b-bab1-5baa3f9a47a9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:06.293751 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6d1bfa90-7c7e-429b-bab1-5baa3f9a47a9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:06.295589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6d1bfa90-7c7e-429b-bab1-5baa3f9a47a9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:06.296839 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6d1bfa90-7c7e-429b-bab1-5baa3f9a47a9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1744 microversion: 2.20 time: 0.262609 Aug 31 11:11:06.297566 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 406/757] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:06 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1744 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:06.801743 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-804be447-b020-4767-8c2c-32d27b28bbc6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:06.803051 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-804be447-b020-4767-8c2c-32d27b28bbc6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:06.811498 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-804be447-b020-4767-8c2c-32d27b28bbc6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:06.811982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-804be447-b020-4767-8c2c-32d27b28bbc6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:06.812643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-804be447-b020-4767-8c2c-32d27b28bbc6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:06.813371 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-804be447-b020-4767-8c2c-32d27b28bbc6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:06.814566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-804be447-b020-4767-8c2c-32d27b28bbc6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:06.815148 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-804be447-b020-4767-8c2c-32d27b28bbc6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:06.861393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:07.052835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-804be447-b020-4767-8c2c-32d27b28bbc6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:07.064498 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-804be447-b020-4767-8c2c-32d27b28bbc6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.269987 Aug 31 11:11:07.077628 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 352/758] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:06 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:07.334440 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4559f937-7184-4843-a000-b44c8d7719e1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:07.335846 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4559f937-7184-4843-a000-b44c8d7719e1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:07.352566 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4559f937-7184-4843-a000-b44c8d7719e1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:07.353704 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4559f937-7184-4843-a000-b44c8d7719e1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:07.355344 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4559f937-7184-4843-a000-b44c8d7719e1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:07.356620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4559f937-7184-4843-a000-b44c8d7719e1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:07.357300 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4559f937-7184-4843-a000-b44c8d7719e1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:07.358383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4559f937-7184-4843-a000-b44c8d7719e1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:07.785000 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4559f937-7184-4843-a000-b44c8d7719e1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:07.797781 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4559f937-7184-4843-a000-b44c8d7719e1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:07.800117 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4559f937-7184-4843-a000-b44c8d7719e1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:07.801429 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4559f937-7184-4843-a000-b44c8d7719e1 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1744 microversion: 2.20 time: 0.479913 Aug 31 11:11:07.801979 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 407/759] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:07 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1744 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:11:08.086495 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-2d920bab-a832-4bff-95da-93ecd0acb5bd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:08.087427 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-2d920bab-a832-4bff-95da-93ecd0acb5bd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:08.096185 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2d920bab-a832-4bff-95da-93ecd0acb5bd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:08.097037 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2d920bab-a832-4bff-95da-93ecd0acb5bd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:08.097881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2d920bab-a832-4bff-95da-93ecd0acb5bd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:08.098965 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2d920bab-a832-4bff-95da-93ecd0acb5bd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:08.099501 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2d920bab-a832-4bff-95da-93ecd0acb5bd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:08.099995 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2d920bab-a832-4bff-95da-93ecd0acb5bd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:08.272486 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-2d920bab-a832-4bff-95da-93ecd0acb5bd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:08.287309 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-2d920bab-a832-4bff-95da-93ecd0acb5bd tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.199376 Aug 31 11:11:08.288196 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 353/760] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:08 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:08.824103 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0d2ac386-30ad-4f65-ad87-ed1d161623fc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:08.824816 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-0d2ac386-30ad-4f65-ad87-ed1d161623fc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:08.835435 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0d2ac386-30ad-4f65-ad87-ed1d161623fc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:08.835932 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0d2ac386-30ad-4f65-ad87-ed1d161623fc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:08.836395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0d2ac386-30ad-4f65-ad87-ed1d161623fc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:08.837104 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0d2ac386-30ad-4f65-ad87-ed1d161623fc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:08.837558 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0d2ac386-30ad-4f65-ad87-ed1d161623fc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:08.837987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0d2ac386-30ad-4f65-ad87-ed1d161623fc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:09.055336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0d2ac386-30ad-4f65-ad87-ed1d161623fc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:09.073671 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-1350b05e-7532-43e9-844d-22943fc50b6a req-e8ca32bc-ffc2-4be9-a3cb-9005cb0a844a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8572f06c-5fe1-4496-b9e7-92ae0d9b6b84", "name": "network-vif-plugged", "status": "completed", "tag": "61614d6e-8cbb-415d-9054-acb80c091e6f"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:09.077132 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0d2ac386-30ad-4f65-ad87-ed1d161623fc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:09.080687 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0d2ac386-30ad-4f65-ad87-ed1d161623fc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:09.084589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-1350b05e-7532-43e9-844d-22943fc50b6a req-e8ca32bc-ffc2-4be9-a3cb-9005cb0a844a service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:09.086039 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-1350b05e-7532-43e9-844d-22943fc50b6a req-e8ca32bc-ffc2-4be9-a3cb-9005cb0a844a service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:09.086722 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-1350b05e-7532-43e9-844d-22943fc50b6a req-e8ca32bc-ffc2-4be9-a3cb-9005cb0a844a service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:09.087889 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0d2ac386-30ad-4f65-ad87-ed1d161623fc tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1739 microversion: 2.20 time: 0.267580 Aug 31 11:11:09.094283 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 408/761] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:08 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:09.100870 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-1350b05e-7532-43e9-844d-22943fc50b6a req-e8ca32bc-ffc2-4be9-a3cb-9005cb0a844a service nova] Creating event network-vif-plugged:61614d6e-8cbb-415d-9054-acb80c091e6f for instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 on hv-cinder-85535 Aug 31 11:11:09.107221 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-1350b05e-7532-43e9-844d-22943fc50b6a req-e8ca32bc-ffc2-4be9-a3cb-9005cb0a844a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037450 Aug 31 11:11:09.108230 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 354/762] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:11:09.307922 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-cead068b-ca54-4bd6-a5fe-e923c4344513 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:09.308473 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-cead068b-ca54-4bd6-a5fe-e923c4344513 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:09.316205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cead068b-ca54-4bd6-a5fe-e923c4344513 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:09.316586 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cead068b-ca54-4bd6-a5fe-e923c4344513 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:09.317096 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cead068b-ca54-4bd6-a5fe-e923c4344513 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:09.317729 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cead068b-ca54-4bd6-a5fe-e923c4344513 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:09.318188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cead068b-ca54-4bd6-a5fe-e923c4344513 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:09.318603 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cead068b-ca54-4bd6-a5fe-e923c4344513 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:09.489579 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-cead068b-ca54-4bd6-a5fe-e923c4344513 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:09.498499 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-cead068b-ca54-4bd6-a5fe-e923c4344513 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.194230 Aug 31 11:11:09.499592 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 409/763] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:09 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:10.118978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-37f5488e-5636-41a4-bcb8-dfecf50191cf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:10.119631 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-37f5488e-5636-41a4-bcb8-dfecf50191cf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:10.126353 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37f5488e-5636-41a4-bcb8-dfecf50191cf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:10.126851 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37f5488e-5636-41a4-bcb8-dfecf50191cf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:10.127312 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37f5488e-5636-41a4-bcb8-dfecf50191cf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:10.128050 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37f5488e-5636-41a4-bcb8-dfecf50191cf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:10.128679 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37f5488e-5636-41a4-bcb8-dfecf50191cf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:10.129262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37f5488e-5636-41a4-bcb8-dfecf50191cf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:10.344595 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-37f5488e-5636-41a4-bcb8-dfecf50191cf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:10.362540 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-37f5488e-5636-41a4-bcb8-dfecf50191cf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:10.364349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-37f5488e-5636-41a4-bcb8-dfecf50191cf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:10.365764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-37f5488e-5636-41a4-bcb8-dfecf50191cf tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1739 microversion: 2.20 time: 0.251539 Aug 31 11:11:10.366525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 355/764] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:10 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:10.523745 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-00638db6-2ddb-4c19-bbdc-55c717c25ced tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:10.524387 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-00638db6-2ddb-4c19-bbdc-55c717c25ced tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:10.535098 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00638db6-2ddb-4c19-bbdc-55c717c25ced tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:10.535731 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00638db6-2ddb-4c19-bbdc-55c717c25ced tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:10.536371 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00638db6-2ddb-4c19-bbdc-55c717c25ced tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:10.537370 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00638db6-2ddb-4c19-bbdc-55c717c25ced tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:10.538021 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00638db6-2ddb-4c19-bbdc-55c717c25ced tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:10.538456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-00638db6-2ddb-4c19-bbdc-55c717c25ced tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:10.775995 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-00638db6-2ddb-4c19-bbdc-55c717c25ced tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:10.786213 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-00638db6-2ddb-4c19-bbdc-55c717c25ced tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.266260 Aug 31 11:11:10.787312 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 410/765] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:10 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:11.389750 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6d6f21ae-44be-44e5-a6be-57154742784a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:11.390430 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6d6f21ae-44be-44e5-a6be-57154742784a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:11.401813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6d6f21ae-44be-44e5-a6be-57154742784a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:11.402826 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6d6f21ae-44be-44e5-a6be-57154742784a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:11.403480 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6d6f21ae-44be-44e5-a6be-57154742784a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:11.404535 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6d6f21ae-44be-44e5-a6be-57154742784a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:11.406336 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6d6f21ae-44be-44e5-a6be-57154742784a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:11.407607 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6d6f21ae-44be-44e5-a6be-57154742784a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:11.718248 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6d6f21ae-44be-44e5-a6be-57154742784a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:11.728453 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6d6f21ae-44be-44e5-a6be-57154742784a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:11.730244 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6d6f21ae-44be-44e5-a6be-57154742784a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:11.731431 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6d6f21ae-44be-44e5-a6be-57154742784a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1739 microversion: 2.20 time: 0.345604 Aug 31 11:11:11.732000 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 356/766] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:11 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:11.811302 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b86a41d7-0833-4b28-a864-4fe917f9eeac tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:11.811943 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b86a41d7-0833-4b28-a864-4fe917f9eeac tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:11.826553 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b86a41d7-0833-4b28-a864-4fe917f9eeac tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:11.827576 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b86a41d7-0833-4b28-a864-4fe917f9eeac tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:11.829923 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b86a41d7-0833-4b28-a864-4fe917f9eeac tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:11.830983 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b86a41d7-0833-4b28-a864-4fe917f9eeac tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:11.831679 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b86a41d7-0833-4b28-a864-4fe917f9eeac tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:11.832363 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b86a41d7-0833-4b28-a864-4fe917f9eeac tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:12.054679 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b86a41d7-0833-4b28-a864-4fe917f9eeac tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:12.070897 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b86a41d7-0833-4b28-a864-4fe917f9eeac tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.265472 Aug 31 11:11:12.071829 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 411/767] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:11 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:12.755226 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d8121568-7d87-44b1-873a-47ff4f59ff72 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:12.756000 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d8121568-7d87-44b1-873a-47ff4f59ff72 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:12.762813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d8121568-7d87-44b1-873a-47ff4f59ff72 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:12.763773 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d8121568-7d87-44b1-873a-47ff4f59ff72 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:12.764236 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d8121568-7d87-44b1-873a-47ff4f59ff72 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:12.765142 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d8121568-7d87-44b1-873a-47ff4f59ff72 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:12.765963 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d8121568-7d87-44b1-873a-47ff4f59ff72 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:12.766806 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d8121568-7d87-44b1-873a-47ff4f59ff72 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:12.971116 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d8121568-7d87-44b1-873a-47ff4f59ff72 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:12.982580 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d8121568-7d87-44b1-873a-47ff4f59ff72 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:12.985218 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d8121568-7d87-44b1-873a-47ff4f59ff72 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:12.986740 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d8121568-7d87-44b1-873a-47ff4f59ff72 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1739 microversion: 2.20 time: 0.235740 Aug 31 11:11:13.012814 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 357/768] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:12 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:13.095530 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2a1db22f-13de-444e-9c59-f9134f4929a2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:13.096961 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2a1db22f-13de-444e-9c59-f9134f4929a2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:13.105469 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a1db22f-13de-444e-9c59-f9134f4929a2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:13.106054 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a1db22f-13de-444e-9c59-f9134f4929a2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:13.106871 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a1db22f-13de-444e-9c59-f9134f4929a2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:13.107860 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a1db22f-13de-444e-9c59-f9134f4929a2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:13.108837 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a1db22f-13de-444e-9c59-f9134f4929a2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:13.109526 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a1db22f-13de-444e-9c59-f9134f4929a2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:13.288370 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2a1db22f-13de-444e-9c59-f9134f4929a2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:13.297250 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2a1db22f-13de-444e-9c59-f9134f4929a2 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.206427 Aug 31 11:11:13.298039 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 412/769] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:13 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:14.024987 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-67a5f5c3-4264-4b31-ac1a-bf001a5396c6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:14.026375 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-67a5f5c3-4264-4b31-ac1a-bf001a5396c6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:14.034822 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-67a5f5c3-4264-4b31-ac1a-bf001a5396c6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:14.035303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-67a5f5c3-4264-4b31-ac1a-bf001a5396c6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:14.035951 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-67a5f5c3-4264-4b31-ac1a-bf001a5396c6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:14.036674 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-67a5f5c3-4264-4b31-ac1a-bf001a5396c6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:14.037285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-67a5f5c3-4264-4b31-ac1a-bf001a5396c6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:14.037702 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-67a5f5c3-4264-4b31-ac1a-bf001a5396c6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:14.220754 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-67a5f5c3-4264-4b31-ac1a-bf001a5396c6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:14.231746 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-67a5f5c3-4264-4b31-ac1a-bf001a5396c6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:14.233545 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-67a5f5c3-4264-4b31-ac1a-bf001a5396c6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:14.234983 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-67a5f5c3-4264-4b31-ac1a-bf001a5396c6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1739 microversion: 2.20 time: 0.216326 Aug 31 11:11:14.248554 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 358/770] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:14 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:14.319529 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2c279ee9-0af4-43ad-8cd8-efb5c5b27c3c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:14.320801 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2c279ee9-0af4-43ad-8cd8-efb5c5b27c3c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:14.323386 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:14.329191 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c279ee9-0af4-43ad-8cd8-efb5c5b27c3c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:14.330078 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c279ee9-0af4-43ad-8cd8-efb5c5b27c3c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:14.330683 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c279ee9-0af4-43ad-8cd8-efb5c5b27c3c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:14.332121 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c279ee9-0af4-43ad-8cd8-efb5c5b27c3c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:14.332924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c279ee9-0af4-43ad-8cd8-efb5c5b27c3c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:14.333517 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2c279ee9-0af4-43ad-8cd8-efb5c5b27c3c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:14.507526 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2c279ee9-0af4-43ad-8cd8-efb5c5b27c3c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:14.516536 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2c279ee9-0af4-43ad-8cd8-efb5c5b27c3c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.200562 Aug 31 11:11:14.517478 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 413/771] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:14 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:15.267501 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-282b6f1e-f746-4b4d-aba9-dfb16fd6dff6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:15.269402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-282b6f1e-f746-4b4d-aba9-dfb16fd6dff6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:15.287537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-282b6f1e-f746-4b4d-aba9-dfb16fd6dff6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:15.289011 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-282b6f1e-f746-4b4d-aba9-dfb16fd6dff6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:15.291031 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-282b6f1e-f746-4b4d-aba9-dfb16fd6dff6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:15.293423 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-282b6f1e-f746-4b4d-aba9-dfb16fd6dff6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:15.294105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-282b6f1e-f746-4b4d-aba9-dfb16fd6dff6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:15.296378 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-282b6f1e-f746-4b4d-aba9-dfb16fd6dff6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:15.529840 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-282b6f1e-f746-4b4d-aba9-dfb16fd6dff6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:15.540540 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6cd91c2f-60c5-44ff-8f61-de54a8df1365 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:15.541329 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6cd91c2f-60c5-44ff-8f61-de54a8df1365 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:15.543796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=4 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:15.547547 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-282b6f1e-f746-4b4d-aba9-dfb16fd6dff6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:15.549302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-282b6f1e-f746-4b4d-aba9-dfb16fd6dff6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:15.549544 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6cd91c2f-60c5-44ff-8f61-de54a8df1365 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:15.550049 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6cd91c2f-60c5-44ff-8f61-de54a8df1365 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:15.550506 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6cd91c2f-60c5-44ff-8f61-de54a8df1365 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:15.551264 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-282b6f1e-f746-4b4d-aba9-dfb16fd6dff6 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1739 microversion: 2.20 time: 0.289757 Aug 31 11:11:15.551531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6cd91c2f-60c5-44ff-8f61-de54a8df1365 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:15.551999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6cd91c2f-60c5-44ff-8f61-de54a8df1365 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:15.552491 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6cd91c2f-60c5-44ff-8f61-de54a8df1365 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:15.553308 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 359/772] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:15 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1739 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:15.713789 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6cd91c2f-60c5-44ff-8f61-de54a8df1365 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:15.723211 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6cd91c2f-60c5-44ff-8f61-de54a8df1365 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1509 microversion: 2.1 time: 0.187666 Aug 31 11:11:15.739171 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 414/773] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:15 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:15.744660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a6d0cfce-f062-4e10-8192-4fb6d25d2e03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:15.745267 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a6d0cfce-f062-4e10-8192-4fb6d25d2e03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:15.751974 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6d0cfce-f062-4e10-8192-4fb6d25d2e03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:15.752487 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6d0cfce-f062-4e10-8192-4fb6d25d2e03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:15.752915 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6d0cfce-f062-4e10-8192-4fb6d25d2e03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:15.753623 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6d0cfce-f062-4e10-8192-4fb6d25d2e03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:15.754069 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6d0cfce-f062-4e10-8192-4fb6d25d2e03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:15.754488 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a6d0cfce-f062-4e10-8192-4fb6d25d2e03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:15.802522 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a6d0cfce-f062-4e10-8192-4fb6d25d2e03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120655) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 11:11:15.889977 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a6d0cfce-f062-4e10-8192-4fb6d25d2e03 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "POST /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d/action" status: 202 len: 0 microversion: 2.1 time: 0.149314 Aug 31 11:11:15.891050 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 360/774] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 11:11:15 2022] POST /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:11:15.900728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-db405dc8-0aaf-4483-837f-db92f6dec687 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:15.901695 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-db405dc8-0aaf-4483-837f-db92f6dec687 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:15.908548 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-db405dc8-0aaf-4483-837f-db92f6dec687 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:15.909088 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-db405dc8-0aaf-4483-837f-db92f6dec687 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:15.910174 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-db405dc8-0aaf-4483-837f-db92f6dec687 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:15.911124 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-db405dc8-0aaf-4483-837f-db92f6dec687 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:15.911747 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-db405dc8-0aaf-4483-837f-db92f6dec687 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:15.912352 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-db405dc8-0aaf-4483-837f-db92f6dec687 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:16.168979 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-db405dc8-0aaf-4483-837f-db92f6dec687 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:16.178522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-db405dc8-0aaf-4483-837f-db92f6dec687 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1517 microversion: 2.1 time: 0.281571 Aug 31 11:11:16.192928 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 415/775] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:15 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:16.585518 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-052cddd1-dfd7-4edf-b61c-475914b7fd02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:16.586557 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-052cddd1-dfd7-4edf-b61c-475914b7fd02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:16.595483 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-052cddd1-dfd7-4edf-b61c-475914b7fd02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:16.597042 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-052cddd1-dfd7-4edf-b61c-475914b7fd02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:16.597698 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-052cddd1-dfd7-4edf-b61c-475914b7fd02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:16.598835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-052cddd1-dfd7-4edf-b61c-475914b7fd02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:16.599678 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-052cddd1-dfd7-4edf-b61c-475914b7fd02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:16.600427 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-052cddd1-dfd7-4edf-b61c-475914b7fd02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:16.776306 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ecd29308-20c4-433f-8c2e-d6ddeb917c03 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:16.779470 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ecd29308-20c4-433f-8c2e-d6ddeb917c03 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:16.783145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-052cddd1-dfd7-4edf-b61c-475914b7fd02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:16.789521 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ecd29308-20c4-433f-8c2e-d6ddeb917c03 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:16.790052 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ecd29308-20c4-433f-8c2e-d6ddeb917c03 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:16.790497 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ecd29308-20c4-433f-8c2e-d6ddeb917c03 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:16.791226 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ecd29308-20c4-433f-8c2e-d6ddeb917c03 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:16.791681 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ecd29308-20c4-433f-8c2e-d6ddeb917c03 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:16.792136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ecd29308-20c4-433f-8c2e-d6ddeb917c03 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:16.806300 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-052cddd1-dfd7-4edf-b61c-475914b7fd02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:16.815046 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-052cddd1-dfd7-4edf-b61c-475914b7fd02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:16.816494 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-052cddd1-dfd7-4edf-b61c-475914b7fd02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1739 microversion: 2.20 time: 0.236483 Aug 31 11:11:16.816961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 361/776] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:16 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:16.838531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ecd29308-20c4-433f-8c2e-d6ddeb917c03 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066042 Aug 31 11:11:16.839698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 416/777] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:11:16 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:11:17.168555 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-054c867c-257e-47dd-8cad-0859383c52c8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:17.169051 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-054c867c-257e-47dd-8cad-0859383c52c8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:17.181197 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-054c867c-257e-47dd-8cad-0859383c52c8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:17.181695 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-054c867c-257e-47dd-8cad-0859383c52c8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:17.182343 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-054c867c-257e-47dd-8cad-0859383c52c8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:17.183050 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-054c867c-257e-47dd-8cad-0859383c52c8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:17.183658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-054c867c-257e-47dd-8cad-0859383c52c8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:17.184526 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-054c867c-257e-47dd-8cad-0859383c52c8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:17.211341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b3d3ae07-69e2-4bf7-ab6d-64c6979cef7f tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:17.213028 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b3d3ae07-69e2-4bf7-ab6d-64c6979cef7f tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:17.224262 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3d3ae07-69e2-4bf7-ab6d-64c6979cef7f tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:17.224804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3d3ae07-69e2-4bf7-ab6d-64c6979cef7f tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:17.225486 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3d3ae07-69e2-4bf7-ab6d-64c6979cef7f tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:17.226370 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3d3ae07-69e2-4bf7-ab6d-64c6979cef7f tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:17.227013 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3d3ae07-69e2-4bf7-ab6d-64c6979cef7f tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:17.227593 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b3d3ae07-69e2-4bf7-ab6d-64c6979cef7f tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:17.244554 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-054c867c-257e-47dd-8cad-0859383c52c8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Going to try to terminate instance {{(pid=120655) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:11:17.389871 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-054c867c-257e-47dd-8cad-0859383c52c8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 204 len: 0 microversion: 2.1 time: 0.224333 Aug 31 11:11:17.392322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 362/778] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:11:17 2022] DELETE /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:11:17.406870 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c9cd6533-e234-4f05-bdae-a8e0ed261bc9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:17.408220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c9cd6533-e234-4f05-bdae-a8e0ed261bc9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:17.416619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c9cd6533-e234-4f05-bdae-a8e0ed261bc9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:17.420388 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c9cd6533-e234-4f05-bdae-a8e0ed261bc9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:17.424961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c9cd6533-e234-4f05-bdae-a8e0ed261bc9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:17.426055 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c9cd6533-e234-4f05-bdae-a8e0ed261bc9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:17.427158 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c9cd6533-e234-4f05-bdae-a8e0ed261bc9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:17.432265 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c9cd6533-e234-4f05-bdae-a8e0ed261bc9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:17.487854 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b3d3ae07-69e2-4bf7-ab6d-64c6979cef7f tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:17.502502 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b3d3ae07-69e2-4bf7-ab6d-64c6979cef7f tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1519 microversion: 2.1 time: 0.301073 Aug 31 11:11:17.507433 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 417/779] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:17 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1519 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:17.620756 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c9cd6533-e234-4f05-bdae-a8e0ed261bc9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:17.629765 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c9cd6533-e234-4f05-bdae-a8e0ed261bc9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1675 microversion: 2.1 time: 0.232440 Aug 31 11:11:17.630945 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 363/780] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:17 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1675 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:17.840455 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-08cfb92a-52f2-41f4-a2b9-300bc112df87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:17.841249 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-08cfb92a-52f2-41f4-a2b9-300bc112df87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:17.848413 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-08cfb92a-52f2-41f4-a2b9-300bc112df87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:17.849309 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-08cfb92a-52f2-41f4-a2b9-300bc112df87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:17.850516 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-08cfb92a-52f2-41f4-a2b9-300bc112df87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:17.851775 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-08cfb92a-52f2-41f4-a2b9-300bc112df87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:17.852490 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-08cfb92a-52f2-41f4-a2b9-300bc112df87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:17.853403 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-08cfb92a-52f2-41f4-a2b9-300bc112df87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:18.021368 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-08cfb92a-52f2-41f4-a2b9-300bc112df87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:18.031680 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-08cfb92a-52f2-41f4-a2b9-300bc112df87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:18.034902 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-08cfb92a-52f2-41f4-a2b9-300bc112df87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:18.037575 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-08cfb92a-52f2-41f4-a2b9-300bc112df87 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1739 microversion: 2.20 time: 0.201214 Aug 31 11:11:18.038500 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 418/781] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:17 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:18.527272 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-77efbfb1-6ac2-42e3-82fe-77935763ea33 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:18.527881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-77efbfb1-6ac2-42e3-82fe-77935763ea33 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:18.535191 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-77efbfb1-6ac2-42e3-82fe-77935763ea33 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:18.536288 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-77efbfb1-6ac2-42e3-82fe-77935763ea33 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:18.536972 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-77efbfb1-6ac2-42e3-82fe-77935763ea33 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:18.537914 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-77efbfb1-6ac2-42e3-82fe-77935763ea33 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:18.538576 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-77efbfb1-6ac2-42e3-82fe-77935763ea33 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:18.539190 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-77efbfb1-6ac2-42e3-82fe-77935763ea33 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:18.654430 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f305729f-2945-4433-8570-7d939e0f491a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:18.655155 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f305729f-2945-4433-8570-7d939e0f491a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:18.666060 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f305729f-2945-4433-8570-7d939e0f491a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:18.667405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f305729f-2945-4433-8570-7d939e0f491a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:18.671064 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f305729f-2945-4433-8570-7d939e0f491a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:18.672113 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f305729f-2945-4433-8570-7d939e0f491a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:18.672589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f305729f-2945-4433-8570-7d939e0f491a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:18.673240 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f305729f-2945-4433-8570-7d939e0f491a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:18.790671 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-77efbfb1-6ac2-42e3-82fe-77935763ea33 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:18.801302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-77efbfb1-6ac2-42e3-82fe-77935763ea33 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1519 microversion: 2.1 time: 0.278102 Aug 31 11:11:18.802168 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 364/782] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:18 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1519 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:18.935165 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f305729f-2945-4433-8570-7d939e0f491a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:18.946032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f305729f-2945-4433-8570-7d939e0f491a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1675 microversion: 2.1 time: 0.294207 Aug 31 11:11:18.947118 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 419/783] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:18 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1675 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:19.065847 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f5726e9d-e57e-4ce9-ba8e-9935901edaed tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:19.067129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f5726e9d-e57e-4ce9-ba8e-9935901edaed tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:19.078977 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f5726e9d-e57e-4ce9-ba8e-9935901edaed tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:19.079578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f5726e9d-e57e-4ce9-ba8e-9935901edaed tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:19.079961 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f5726e9d-e57e-4ce9-ba8e-9935901edaed tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:19.086150 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f5726e9d-e57e-4ce9-ba8e-9935901edaed tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:19.086882 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f5726e9d-e57e-4ce9-ba8e-9935901edaed tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:19.087490 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f5726e9d-e57e-4ce9-ba8e-9935901edaed tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:19.124181 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=100 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:19.154896 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-a03ab2aa-9c0f-4df8-b9ae-79d494dfa112 req-068aa20f-c8e5-4c80-8015-83cb2c58a4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2a8d50-fa16-40f4-9760-25603efd4d6d", "name": "network-vif-unplugged", "status": "completed", "tag": "e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:19.169482 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-a03ab2aa-9c0f-4df8-b9ae-79d494dfa112 req-068aa20f-c8e5-4c80-8015-83cb2c58a4d6 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:19.170271 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-a03ab2aa-9c0f-4df8-b9ae-79d494dfa112 req-068aa20f-c8e5-4c80-8015-83cb2c58a4d6 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:19.171184 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-a03ab2aa-9c0f-4df8-b9ae-79d494dfa112 req-068aa20f-c8e5-4c80-8015-83cb2c58a4d6 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:19.203227 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.compute.server_external_events [req-a03ab2aa-9c0f-4df8-b9ae-79d494dfa112 req-068aa20f-c8e5-4c80-8015-83cb2c58a4d6 service nova] Unable to find a host for instance dd2a8d50-fa16-40f4-9760-25603efd4d6d. Dropping event network-vif-unplugged {{(pid=120655) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 11:11:19.206717 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-a03ab2aa-9c0f-4df8-b9ae-79d494dfa112 req-068aa20f-c8e5-4c80-8015-83cb2c58a4d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.248009 Aug 31 11:11:19.208116 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 365/784] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 251 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 11:11:19.315181 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f5726e9d-e57e-4ce9-ba8e-9935901edaed tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:19.325595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f5726e9d-e57e-4ce9-ba8e-9935901edaed tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:19.326573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f5726e9d-e57e-4ce9-ba8e-9935901edaed tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:19.328066 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f5726e9d-e57e-4ce9-ba8e-9935901edaed tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1739 microversion: 2.20 time: 0.266243 Aug 31 11:11:19.329013 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 420/785] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:19 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:11:19.823274 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f26e230a-e31b-4594-ae01-279ef6e28b79 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:19.823865 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-f26e230a-e31b-4594-ae01-279ef6e28b79 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:19.830541 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f26e230a-e31b-4594-ae01-279ef6e28b79 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:19.831017 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f26e230a-e31b-4594-ae01-279ef6e28b79 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:19.831448 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f26e230a-e31b-4594-ae01-279ef6e28b79 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:19.832173 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f26e230a-e31b-4594-ae01-279ef6e28b79 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:19.832625 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f26e230a-e31b-4594-ae01-279ef6e28b79 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:19.833038 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f26e230a-e31b-4594-ae01-279ef6e28b79 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:19.970567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c83f20dd-1f66-4496-aed5-7d67bb719149 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:19.971790 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c83f20dd-1f66-4496-aed5-7d67bb719149 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:19.978566 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c83f20dd-1f66-4496-aed5-7d67bb719149 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:19.979275 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c83f20dd-1f66-4496-aed5-7d67bb719149 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:19.979796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c83f20dd-1f66-4496-aed5-7d67bb719149 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:19.980586 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c83f20dd-1f66-4496-aed5-7d67bb719149 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:19.981059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c83f20dd-1f66-4496-aed5-7d67bb719149 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:19.981479 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c83f20dd-1f66-4496-aed5-7d67bb719149 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:20.133940 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c83f20dd-1f66-4496-aed5-7d67bb719149 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:20.143432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c83f20dd-1f66-4496-aed5-7d67bb719149 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1675 microversion: 2.1 time: 0.177585 Aug 31 11:11:20.144080 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 421/786] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:19 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:20.202289 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-f26e230a-e31b-4594-ae01-279ef6e28b79 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:20.210809 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-f26e230a-e31b-4594-ae01-279ef6e28b79 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.391412 Aug 31 11:11:20.211404 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 366/787] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:19 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:20.354802 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9c10ab1e-1acf-4508-a164-5cd8994cd3d2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:20.355399 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9c10ab1e-1acf-4508-a164-5cd8994cd3d2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:20.361419 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c10ab1e-1acf-4508-a164-5cd8994cd3d2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:20.361909 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c10ab1e-1acf-4508-a164-5cd8994cd3d2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:20.362336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c10ab1e-1acf-4508-a164-5cd8994cd3d2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:20.363073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c10ab1e-1acf-4508-a164-5cd8994cd3d2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:20.363468 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c10ab1e-1acf-4508-a164-5cd8994cd3d2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:20.363888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c10ab1e-1acf-4508-a164-5cd8994cd3d2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:20.523149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9c10ab1e-1acf-4508-a164-5cd8994cd3d2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:20.531335 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9c10ab1e-1acf-4508-a164-5cd8994cd3d2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:20.533185 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9c10ab1e-1acf-4508-a164-5cd8994cd3d2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:20.534691 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9c10ab1e-1acf-4508-a164-5cd8994cd3d2 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1721 microversion: 2.20 time: 0.183559 Aug 31 11:11:20.535271 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 422/788] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:20 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:21.168251 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-90c33390-4861-43e7-b0d5-55f0c5f98b83 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:21.169087 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-90c33390-4861-43e7-b0d5-55f0c5f98b83 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:21.177355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90c33390-4861-43e7-b0d5-55f0c5f98b83 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:21.177928 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90c33390-4861-43e7-b0d5-55f0c5f98b83 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:21.178446 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90c33390-4861-43e7-b0d5-55f0c5f98b83 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:21.179213 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90c33390-4861-43e7-b0d5-55f0c5f98b83 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:21.179745 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90c33390-4861-43e7-b0d5-55f0c5f98b83 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:21.180249 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90c33390-4861-43e7-b0d5-55f0c5f98b83 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:21.233810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-accad64f-5958-4a2c-8aa3-f75e060eab54 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:21.234562 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-accad64f-5958-4a2c-8aa3-f75e060eab54 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:21.242224 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-accad64f-5958-4a2c-8aa3-f75e060eab54 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:21.243225 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-accad64f-5958-4a2c-8aa3-f75e060eab54 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:21.243831 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-accad64f-5958-4a2c-8aa3-f75e060eab54 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:21.244726 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-accad64f-5958-4a2c-8aa3-f75e060eab54 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:21.245335 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-accad64f-5958-4a2c-8aa3-f75e060eab54 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:21.246081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-accad64f-5958-4a2c-8aa3-f75e060eab54 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:21.311257 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-90c33390-4861-43e7-b0d5-55f0c5f98b83 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:21.315260 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:21.319989 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-90c33390-4861-43e7-b0d5-55f0c5f98b83 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1607 microversion: 2.1 time: 0.157660 Aug 31 11:11:21.320598 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 367/789] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:21 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1607 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:21.456833 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-accad64f-5958-4a2c-8aa3-f75e060eab54 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:21.465925 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-accad64f-5958-4a2c-8aa3-f75e060eab54 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.236366 Aug 31 11:11:21.466738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 423/790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:21 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:21.558876 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-99082d70-793f-452a-a8bd-b8fe54213afb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:21.559573 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-99082d70-793f-452a-a8bd-b8fe54213afb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:21.566399 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-99082d70-793f-452a-a8bd-b8fe54213afb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:21.566971 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-99082d70-793f-452a-a8bd-b8fe54213afb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:21.567556 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-99082d70-793f-452a-a8bd-b8fe54213afb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:21.568282 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-99082d70-793f-452a-a8bd-b8fe54213afb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:21.568829 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-99082d70-793f-452a-a8bd-b8fe54213afb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:21.569324 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-99082d70-793f-452a-a8bd-b8fe54213afb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:21.837022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-fcdd922d-ef03-4cdd-859c-2b03bcc58897 req-cb65c88c-2143-491a-abfa-3a883e55813d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50ff8cd-8095-43f9-9b25-30536f129ac3", "name": "network-vif-deleted", "tag": "21aa5d3b-5335-4948-b4c1-66ad46c33844"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:21.855463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-fcdd922d-ef03-4cdd-859c-2b03bcc58897 req-cb65c88c-2143-491a-abfa-3a883e55813d service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:21.855947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-fcdd922d-ef03-4cdd-859c-2b03bcc58897 req-cb65c88c-2143-491a-abfa-3a883e55813d service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:21.856407 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-fcdd922d-ef03-4cdd-859c-2b03bcc58897 req-cb65c88c-2143-491a-abfa-3a883e55813d service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:21.888290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-fcdd922d-ef03-4cdd-859c-2b03bcc58897 req-cb65c88c-2143-491a-abfa-3a883e55813d service nova] Creating event network-vif-deleted:21aa5d3b-5335-4948-b4c1-66ad46c33844 for instance b50ff8cd-8095-43f9-9b25-30536f129ac3 on hv-cinder-85535 Aug 31 11:11:21.894296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-fcdd922d-ef03-4cdd-859c-2b03bcc58897 req-cb65c88c-2143-491a-abfa-3a883e55813d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060769 Aug 31 11:11:21.895633 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 424/791] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:11:21.974318 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-99082d70-793f-452a-a8bd-b8fe54213afb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:21.983182 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-99082d70-793f-452a-a8bd-b8fe54213afb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:21.985159 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-99082d70-793f-452a-a8bd-b8fe54213afb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:21.986555 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-99082d70-793f-452a-a8bd-b8fe54213afb tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1721 microversion: 2.20 time: 0.432186 Aug 31 11:11:21.987204 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 368/792] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:21 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1721 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:22.341930 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:22.342634 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:22.349044 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:22.349539 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:22.349978 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:22.350690 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:22.351152 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:22.351583 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:22.385796 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:22.386286 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:22.386727 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:22.387183 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lazy-loading 'fault' on Instance uuid b50ff8cd-8095-43f9-9b25-30536f129ac3 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:11:22.432883 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:22.442226 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4ddd7ab3-a823-4034-86e3-47d26253520a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 200 len: 1328 microversion: 2.1 time: 0.104432 Aug 31 11:11:22.442690 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 425/793] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:22 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:22.487608 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7a631a1d-8f07-4548-90ef-e09776bab133 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:22.488796 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-7a631a1d-8f07-4548-90ef-e09776bab133 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:22.495906 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7a631a1d-8f07-4548-90ef-e09776bab133 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:22.496505 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7a631a1d-8f07-4548-90ef-e09776bab133 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:22.497120 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7a631a1d-8f07-4548-90ef-e09776bab133 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:22.497796 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7a631a1d-8f07-4548-90ef-e09776bab133 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:22.498450 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7a631a1d-8f07-4548-90ef-e09776bab133 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:22.499516 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7a631a1d-8f07-4548-90ef-e09776bab133 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:22.737675 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7a631a1d-8f07-4548-90ef-e09776bab133 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:22.757301 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7a631a1d-8f07-4548-90ef-e09776bab133 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.274107 Aug 31 11:11:22.772612 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 369/794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:22 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:22.978018 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-15ad860e-54a4-4757-8b09-a36b13e397b0 req-891e25fc-a2bf-4ed2-9ef0-3117a5667669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8572f06c-5fe1-4496-b9e7-92ae0d9b6b84", "name": "network-vif-unplugged", "status": "completed", "tag": "61614d6e-8cbb-415d-9054-acb80c091e6f"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:22.992387 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-15ad860e-54a4-4757-8b09-a36b13e397b0 req-891e25fc-a2bf-4ed2-9ef0-3117a5667669 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:22.993128 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-15ad860e-54a4-4757-8b09-a36b13e397b0 req-891e25fc-a2bf-4ed2-9ef0-3117a5667669 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:22.993747 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-15ad860e-54a4-4757-8b09-a36b13e397b0 req-891e25fc-a2bf-4ed2-9ef0-3117a5667669 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:23.010603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9a3c00ca-a19d-4694-8e11-3f9cdb137ad9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:23.011218 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-9a3c00ca-a19d-4694-8e11-3f9cdb137ad9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:23.018859 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9a3c00ca-a19d-4694-8e11-3f9cdb137ad9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:23.024993 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9a3c00ca-a19d-4694-8e11-3f9cdb137ad9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:23.025731 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9a3c00ca-a19d-4694-8e11-3f9cdb137ad9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:23.026629 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9a3c00ca-a19d-4694-8e11-3f9cdb137ad9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:23.028477 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9a3c00ca-a19d-4694-8e11-3f9cdb137ad9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:23.029052 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9a3c00ca-a19d-4694-8e11-3f9cdb137ad9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:23.054303 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-15ad860e-54a4-4757-8b09-a36b13e397b0 req-891e25fc-a2bf-4ed2-9ef0-3117a5667669 service nova] Creating event network-vif-unplugged:61614d6e-8cbb-415d-9054-acb80c091e6f for instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 on hv-cinder-85535 Aug 31 11:11:23.063110 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-15ad860e-54a4-4757-8b09-a36b13e397b0 req-891e25fc-a2bf-4ed2-9ef0-3117a5667669 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088679 Aug 31 11:11:23.063740 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 426/795] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:11:23.317603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-9a3c00ca-a19d-4694-8e11-3f9cdb137ad9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:23.325935 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-9a3c00ca-a19d-4694-8e11-3f9cdb137ad9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:23.327368 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-9a3c00ca-a19d-4694-8e11-3f9cdb137ad9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:23.329199 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-9a3c00ca-a19d-4694-8e11-3f9cdb137ad9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1721 microversion: 2.20 time: 0.323142 Aug 31 11:11:23.339217 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 370/796] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:23 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:11:23.464373 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d1072f74-2914-491b-b225-c5d2dbf244ac tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:23.465258 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d1072f74-2914-491b-b225-c5d2dbf244ac tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:23.473404 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d1072f74-2914-491b-b225-c5d2dbf244ac tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:23.473968 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d1072f74-2914-491b-b225-c5d2dbf244ac tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:23.474407 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d1072f74-2914-491b-b225-c5d2dbf244ac tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:23.475195 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d1072f74-2914-491b-b225-c5d2dbf244ac tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:23.475654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d1072f74-2914-491b-b225-c5d2dbf244ac tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:23.476106 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d1072f74-2914-491b-b225-c5d2dbf244ac tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:23.490406 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-d1072f74-2914-491b-b225-c5d2dbf244ac tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] HTTP exception thrown: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d1072f74-2914-491b-b225-c5d2dbf244ac tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Request method failure captured: Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 HTTP/1.1 Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0Dc1o31b2k1pptqFe_qjwnSjSeAdPSEIVCMs4gvjDXBQRmJgV8S57u1XRfg78SoBQ7nlkGN12g2GL_BovwAqcUS5FLXtLiOn2i7jOdRqZDXXEdOClIn1KUNu78q1J2z4Np5O4vwRYD2t-NBegtkrAaxDGNSmhOctQIcvai94Ziw8k8 Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 00b397afc10243bc9b93548873add6ef Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:11:23.492057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:11:23.493677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00b397afc10243bc9b93548873add6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00b397afc10243bc9b93548873add6ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00b397afc10243bc9b93548873add6ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00b397afc10243bc9b93548873add6ef"}]}] Aug 31 11:11:23.493677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:11:23.493677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 00b397afc10243bc9b93548873add6ef Aug 31 11:11:23.493677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:11:23.493677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-AttachVolumeTestJSON-1324231620-project Aug 31 11:11:23.493677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:11:23.493677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:11:23.493677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 81d937b8a6c842819458b6e3c23f80fa Aug 31 11:11:23.493677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-AttachVolumeTestJSON-1324231620-project Aug 31 11:11:23.493677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:11:23.493677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:11:23.493677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': 'b50ff8cd-8095-43f9-9b25-30536f129ac3'} Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:11:23.494589 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:11:23.496794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:11:23.499107 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d1072f74-2914-491b-b225-c5d2dbf244ac tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Returning 404 to user: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:11:23.499107 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d1072f74-2914-491b-b225-c5d2dbf244ac tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 404 len: 111 microversion: 2.1 time: 0.034311 Aug 31 11:11:23.499107 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 427/797] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:23 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:11:23.503150 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8b06aa7d-1961-42a3-997a-33f4ec624b7a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '.version_select at 0x7f732d3061f0>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:23.521712 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8b06aa7d-1961-42a3-997a-33f4ec624b7a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600609806" status: 202 len: 0 microversion: 2.1 time: 0.022842 Aug 31 11:11:23.522279 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 371/798] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 31 11:11:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600609806 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:11:23.782257 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b159f992-9275-419c-8bfc-5f5894eabe55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:23.783420 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b159f992-9275-419c-8bfc-5f5894eabe55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:23.792911 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b159f992-9275-419c-8bfc-5f5894eabe55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:23.793940 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b159f992-9275-419c-8bfc-5f5894eabe55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:23.794745 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b159f992-9275-419c-8bfc-5f5894eabe55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:23.795717 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b159f992-9275-419c-8bfc-5f5894eabe55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:23.796438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b159f992-9275-419c-8bfc-5f5894eabe55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:23.797681 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b159f992-9275-419c-8bfc-5f5894eabe55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:23.874799 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-188588373", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1158123877", "security_groups": [{"name": "tempest-secgroup-smoke-320297181"}], "block_device_mapping_v2": [{"uuid": "48725585-4895-480a-878e-561a4cec0194", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fdfc4a33-02c2-4205-b00d-34df8bb675d5"}]}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:23.995477 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.network.neutron [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] validate_networks() for [('fdfc4a33-02c2-4205-b00d-34df8bb675d5', None, None, None, None, None)] {{(pid=120655) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:11:24.028272 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b159f992-9275-419c-8bfc-5f5894eabe55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:24.037295 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b159f992-9275-419c-8bfc-5f5894eabe55 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.260484 Aug 31 11:11:24.037862 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 428/799] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:23 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:24.302846 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-cd0d6f35-1e25-4d14-935b-f50e30e36b1f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Action: 'create', calling method: .version_select at 0x7f732d220040>, body: {"keypair": {"name": "tempest-keypair-1998678902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9r41Xejw9pUEAiV5RT92QsU3l1vORt4rt3LE7eJCbqcJ+axNniCXYULps/laNvMK8kaGI4bmt76c6zQowaUOYi3o+MvO7a/JkIzQ2/DM0HMCx6Zx26TiPuAUMCpAcVNw=="}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:24.321257 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-cd0d6f35-1e25-4d14-935b-f50e30e36b1f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Getting quotas for project 00b397afc10243bc9b93548873add6ef. Resources: {'key_pairs'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:11:24.325392 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-cd0d6f35-1e25-4d14-935b-f50e30e36b1f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Getting quotas for user 81d937b8a6c842819458b6e3c23f80fa and project 00b397afc10243bc9b93548873add6ef. Resources: {'key_pairs'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:11:24.356901 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-cd0d6f35-1e25-4d14-935b-f50e30e36b1f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057908 Aug 31 11:11:24.357500 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 429/800] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 11:11:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:11:24.364383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8e7d3ae3-837a-492b-8b1b-22e3941068c4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:24.364383 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8e7d3ae3-837a-492b-8b1b-22e3941068c4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:24.369646 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e7d3ae3-837a-492b-8b1b-22e3941068c4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:24.370130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e7d3ae3-837a-492b-8b1b-22e3941068c4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:24.370631 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e7d3ae3-837a-492b-8b1b-22e3941068c4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:24.371516 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e7d3ae3-837a-492b-8b1b-22e3941068c4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:24.372152 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e7d3ae3-837a-492b-8b1b-22e3941068c4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:24.372731 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e7d3ae3-837a-492b-8b1b-22e3941068c4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:24.587035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8e7d3ae3-837a-492b-8b1b-22e3941068c4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:24.601185 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8e7d3ae3-837a-492b-8b1b-22e3941068c4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:24.604370 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8e7d3ae3-837a-492b-8b1b-22e3941068c4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:24.606268 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8e7d3ae3-837a-492b-8b1b-22e3941068c4 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1721 microversion: 2.20 time: 0.247506 Aug 31 11:11:24.607437 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 430/801] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:24 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:24.879963 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Flavor limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:11:24.880480 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Image limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:11:24.880856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Flavor pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:11:24.881253 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Image pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:11:24.881657 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:11:24.892704 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:24.893170 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:24.894018 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:24.894315 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:24.894991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:24.895698 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:24.914126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Getting quotas for project da5b36cb688f49e1bf1cf75a108858fa. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:11:24.918094 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Getting quotas for user 16696c34de254f3babf538c879f2ce49 and project da5b36cb688f49e1bf1cf75a108858fa. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:11:24.995034 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Going to run 1 instances... {{(pid=120655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:11:24.997418 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48725585-4895-480a-878e-561a4cec0194',volume_size=None,volume_type=None)] {{(pid=120655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:11:25.058797 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5077ee94-fe96-4623-9f35-0a4eb0e0df52 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:25.059422 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5077ee94-fe96-4623-9f35-0a4eb0e0df52 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:25.069571 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5077ee94-fe96-4623-9f35-0a4eb0e0df52 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:25.071080 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5077ee94-fe96-4623-9f35-0a4eb0e0df52 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:25.071834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5077ee94-fe96-4623-9f35-0a4eb0e0df52 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:25.073949 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5077ee94-fe96-4623-9f35-0a4eb0e0df52 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:25.074992 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5077ee94-fe96-4623-9f35-0a4eb0e0df52 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:25.075652 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5077ee94-fe96-4623-9f35-0a4eb0e0df52 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:25.202479 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-de973d22-8b1b-48d4-918a-d7b64d859802 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.331177 Aug 31 11:11:25.203698 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 372/802] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:11:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 11:11:25.214826 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-70e7d85a-4eb1-4f28-b27c-e3735b2f5125 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:25.216721 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-70e7d85a-4eb1-4f28-b27c-e3735b2f5125 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:25.300511 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-70e7d85a-4eb1-4f28-b27c-e3735b2f5125 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:25.312696 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-70e7d85a-4eb1-4f28-b27c-e3735b2f5125 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1094 microversion: 2.1 time: 0.102208 Aug 31 11:11:25.318375 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 373/803] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:25 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1094 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:25.354205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-5077ee94-fe96-4623-9f35-0a4eb0e0df52 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:25.367733 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-5077ee94-fe96-4623-9f35-0a4eb0e0df52 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.312754 Aug 31 11:11:25.368375 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 431/804] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:25 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:25.630710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-eeba713a-d7a7-4d4e-998f-a3ae89516634 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:25.631479 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-eeba713a-d7a7-4d4e-998f-a3ae89516634 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:25.641376 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eeba713a-d7a7-4d4e-998f-a3ae89516634 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:25.643888 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eeba713a-d7a7-4d4e-998f-a3ae89516634 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:25.644465 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eeba713a-d7a7-4d4e-998f-a3ae89516634 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:25.647985 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eeba713a-d7a7-4d4e-998f-a3ae89516634 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:25.648569 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eeba713a-d7a7-4d4e-998f-a3ae89516634 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:25.649068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-eeba713a-d7a7-4d4e-998f-a3ae89516634 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:25.879290 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-eeba713a-d7a7-4d4e-998f-a3ae89516634 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:25.892415 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-eeba713a-d7a7-4d4e-998f-a3ae89516634 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:25.894221 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-eeba713a-d7a7-4d4e-998f-a3ae89516634 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:25.895850 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-eeba713a-d7a7-4d4e-998f-a3ae89516634 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1664 microversion: 2.20 time: 0.269181 Aug 31 11:11:25.909405 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 374/805] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:25 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1664 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:25.927229 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-46a7faf0-89e2-4df1-bf13-3e138bdffe3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec2940ee-db54-45c3-96a1-29d131c10b4b"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:25.930251 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-46a7faf0-89e2-4df1-bf13-3e138bdffe3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:25.936647 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46a7faf0-89e2-4df1-bf13-3e138bdffe3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:25.937132 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46a7faf0-89e2-4df1-bf13-3e138bdffe3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:25.938191 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46a7faf0-89e2-4df1-bf13-3e138bdffe3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:25.938887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46a7faf0-89e2-4df1-bf13-3e138bdffe3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:25.939545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46a7faf0-89e2-4df1-bf13-3e138bdffe3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:25.939972 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-46a7faf0-89e2-4df1-bf13-3e138bdffe3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:26.285237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-46a7faf0-89e2-4df1-bf13-3e138bdffe3c tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "POST /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.364390 Aug 31 11:11:26.286170 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 432/806] 10.222.0.20 () {62 vars in 1364 bytes} [Wed Aug 31 11:11:25 2022] POST /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/os-volume_attachments => generated 188 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:11:26.338617 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-97b33237-ba90-422e-b9f0-772b2917c846 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:26.339234 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-97b33237-ba90-422e-b9f0-772b2917c846 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:26.361890 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-97b33237-ba90-422e-b9f0-772b2917c846 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:26.362379 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-97b33237-ba90-422e-b9f0-772b2917c846 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:26.362944 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-97b33237-ba90-422e-b9f0-772b2917c846 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:26.363811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-97b33237-ba90-422e-b9f0-772b2917c846 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:26.368975 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-97b33237-ba90-422e-b9f0-772b2917c846 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:26.369484 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-97b33237-ba90-422e-b9f0-772b2917c846 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:26.374364 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-608741066", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23e68a2b-4538-4158-bc21-13f4527b98dd"}], "security_groups": [{"name": "tempest-securitygroup--715634355"}], "key_name": "tempest-keypair-1998678902", "user_data": "}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:26.478851 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-97b33237-ba90-422e-b9f0-772b2917c846 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:26.501532 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-97b33237-ba90-422e-b9f0-772b2917c846 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1192 microversion: 2.1 time: 0.167006 Aug 31 11:11:26.502124 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 375/807] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:26 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1192 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:26.506887 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4c75386b-d9e9-48cb-ae88-a551c20444fb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:26.508080 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-4c75386b-d9e9-48cb-ae88-a551c20444fb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:26.516169 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4c75386b-d9e9-48cb-ae88-a551c20444fb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:26.516914 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4c75386b-d9e9-48cb-ae88-a551c20444fb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:26.517344 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4c75386b-d9e9-48cb-ae88-a551c20444fb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:26.518045 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4c75386b-d9e9-48cb-ae88-a551c20444fb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:26.518491 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4c75386b-d9e9-48cb-ae88-a551c20444fb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:26.519691 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4c75386b-d9e9-48cb-ae88-a551c20444fb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:26.568477 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] validate_networks() for [('23e68a2b-4538-4158-bc21-13f4527b98dd', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:11:26.774354 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4c75386b-d9e9-48cb-ae88-a551c20444fb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:26.784416 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4c75386b-d9e9-48cb-ae88-a551c20444fb tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.279841 Aug 31 11:11:26.790204 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 376/808] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:26 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:26.795743 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a0092928-f80a-4932-a39d-20821259df67 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:26.797852 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a0092928-f80a-4932-a39d-20821259df67 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:26.806179 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0092928-f80a-4932-a39d-20821259df67 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:26.806662 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0092928-f80a-4932-a39d-20821259df67 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:26.807387 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0092928-f80a-4932-a39d-20821259df67 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:26.808329 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0092928-f80a-4932-a39d-20821259df67 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:26.808790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0092928-f80a-4932-a39d-20821259df67 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:26.809211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a0092928-f80a-4932-a39d-20821259df67 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:27.030831 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:11:27.031406 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:11:27.032124 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:11:27.032717 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:11:27.033121 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:11:27.044397 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:27.045062 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:27.045806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:27.048888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:27.049552 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:27.050156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:27.071707 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Getting quotas for project 00b397afc10243bc9b93548873add6ef. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:11:27.076735 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Getting quotas for user 81d937b8a6c842819458b6e3c23f80fa and project 00b397afc10243bc9b93548873add6ef. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:11:27.089469 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:11:27.092234 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:11:27.151871 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-dffbd3e7-67c3-44ec-a7cc-cdc4be2950fe tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.781798 Aug 31 11:11:27.153408 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 433/809] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:11:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 11:11:27.168069 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-eac6ff26-3062-4d1e-81ec-58fd1ae5eff6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:27.169576 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-eac6ff26-3062-4d1e-81ec-58fd1ae5eff6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:27.256049 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a0092928-f80a-4932-a39d-20821259df67 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/os-volume_attachments/ec2940ee-db54-45c3-96a1-29d131c10b4b" status: 202 len: 0 microversion: 2.20 time: 0.464401 Aug 31 11:11:27.260650 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 377/810] 10.222.0.20 () {60 vars in 1457 bytes} [Wed Aug 31 11:11:26 2022] DELETE /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/os-volume_attachments/ec2940ee-db54-45c3-96a1-29d131c10b4b => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:11:27.351315 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-eac6ff26-3062-4d1e-81ec-58fd1ae5eff6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:27.354015 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ae79ac0b-8b33-4d9e-8fdd-9c606e9bad3f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:27.354622 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ae79ac0b-8b33-4d9e-8fdd-9c606e9bad3f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:27.361638 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-eac6ff26-3062-4d1e-81ec-58fd1ae5eff6 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1237 microversion: 2.1 time: 0.199012 Aug 31 11:11:27.368392 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ae79ac0b-8b33-4d9e-8fdd-9c606e9bad3f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:27.368891 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ae79ac0b-8b33-4d9e-8fdd-9c606e9bad3f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:27.369524 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ae79ac0b-8b33-4d9e-8fdd-9c606e9bad3f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:27.372280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ae79ac0b-8b33-4d9e-8fdd-9c606e9bad3f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:27.373504 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ae79ac0b-8b33-4d9e-8fdd-9c606e9bad3f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:27.374217 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 434/811] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:27 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1237 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:27.374954 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ae79ac0b-8b33-4d9e-8fdd-9c606e9bad3f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:27.447264 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ae79ac0b-8b33-4d9e-8fdd-9c606e9bad3f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120655) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 11:11:27.526942 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7a6882ad-b95b-4317-a54f-0f17b5554bfd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:27.533328 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7a6882ad-b95b-4317-a54f-0f17b5554bfd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:27.542820 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7a6882ad-b95b-4317-a54f-0f17b5554bfd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:27.543649 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7a6882ad-b95b-4317-a54f-0f17b5554bfd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:27.544637 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7a6882ad-b95b-4317-a54f-0f17b5554bfd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:27.545905 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7a6882ad-b95b-4317-a54f-0f17b5554bfd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:27.547164 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7a6882ad-b95b-4317-a54f-0f17b5554bfd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:27.547844 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7a6882ad-b95b-4317-a54f-0f17b5554bfd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:27.551868 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ae79ac0b-8b33-4d9e-8fdd-9c606e9bad3f tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "POST /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/action" status: 202 len: 0 microversion: 2.20 time: 0.202394 Aug 31 11:11:27.553165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 378/812] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 31 11:11:27 2022] POST /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:11:27.561647 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7e11ddba-027d-4726-80b0-49705cacf645 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:27.563394 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-7e11ddba-027d-4726-80b0-49705cacf645 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:27.571650 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7e11ddba-027d-4726-80b0-49705cacf645 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:27.572438 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7e11ddba-027d-4726-80b0-49705cacf645 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:27.573160 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7e11ddba-027d-4726-80b0-49705cacf645 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:27.574059 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7e11ddba-027d-4726-80b0-49705cacf645 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:27.574658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7e11ddba-027d-4726-80b0-49705cacf645 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:27.575222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7e11ddba-027d-4726-80b0-49705cacf645 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:27.737151 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7a6882ad-b95b-4317-a54f-0f17b5554bfd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:27.747083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7a6882ad-b95b-4317-a54f-0f17b5554bfd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.227249 Aug 31 11:11:27.748444 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 435/813] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:27 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:27.808481 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-97a78e37-3a37-4392-8860-174b4f0fae01 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:27.809944 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-97a78e37-3a37-4392-8860-174b4f0fae01 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:27.827848 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-97a78e37-3a37-4392-8860-174b4f0fae01 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:27.830048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-97a78e37-3a37-4392-8860-174b4f0fae01 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:27.831961 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-97a78e37-3a37-4392-8860-174b4f0fae01 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:27.834469 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-97a78e37-3a37-4392-8860-174b4f0fae01 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:27.835207 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-97a78e37-3a37-4392-8860-174b4f0fae01 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:27.836380 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-97a78e37-3a37-4392-8860-174b4f0fae01 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:27.965039 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7e11ddba-027d-4726-80b0-49705cacf645 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:27.986744 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7e11ddba-027d-4726-80b0-49705cacf645 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:27.996973 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7e11ddba-027d-4726-80b0-49705cacf645 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:27.998640 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7e11ddba-027d-4726-80b0-49705cacf645 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1672 microversion: 2.20 time: 0.441658 Aug 31 11:11:27.999238 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 379/814] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:27 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1672 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:28.054267 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-97a78e37-3a37-4392-8860-174b4f0fae01 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:28.067788 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-97a78e37-3a37-4392-8860-174b4f0fae01 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.265176 Aug 31 11:11:28.068556 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 436/815] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:27 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:28.383365 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-878cff53-cc32-4584-be83-c7be72c92084 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:28.384675 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-878cff53-cc32-4584-be83-c7be72c92084 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:28.397188 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-878cff53-cc32-4584-be83-c7be72c92084 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:28.398037 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-878cff53-cc32-4584-be83-c7be72c92084 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:28.398687 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-878cff53-cc32-4584-be83-c7be72c92084 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:28.404760 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-878cff53-cc32-4584-be83-c7be72c92084 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:28.405447 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-878cff53-cc32-4584-be83-c7be72c92084 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:28.406157 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-878cff53-cc32-4584-be83-c7be72c92084 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:28.524500 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-878cff53-cc32-4584-be83-c7be72c92084 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:28.536035 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-878cff53-cc32-4584-be83-c7be72c92084 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1289 microversion: 2.1 time: 0.156626 Aug 31 11:11:28.536875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 380/816] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:28 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1289 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:28.769480 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-98edc212-a665-476b-9921-1a10363e40fd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:28.770361 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-98edc212-a665-476b-9921-1a10363e40fd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:28.784548 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-98edc212-a665-476b-9921-1a10363e40fd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:28.785192 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-98edc212-a665-476b-9921-1a10363e40fd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:28.789636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-98edc212-a665-476b-9921-1a10363e40fd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:28.790463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-98edc212-a665-476b-9921-1a10363e40fd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:28.791006 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-98edc212-a665-476b-9921-1a10363e40fd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:28.791509 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-98edc212-a665-476b-9921-1a10363e40fd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:29.022986 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a1abb828-64f0-45ea-8805-6e4d86868d31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:29.023763 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a1abb828-64f0-45ea-8805-6e4d86868d31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:29.036295 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a1abb828-64f0-45ea-8805-6e4d86868d31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:29.036879 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a1abb828-64f0-45ea-8805-6e4d86868d31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:29.037381 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a1abb828-64f0-45ea-8805-6e4d86868d31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:29.037518 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-98edc212-a665-476b-9921-1a10363e40fd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:29.038393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a1abb828-64f0-45ea-8805-6e4d86868d31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:29.039690 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a1abb828-64f0-45ea-8805-6e4d86868d31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:29.040501 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a1abb828-64f0-45ea-8805-6e4d86868d31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:29.050601 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-98edc212-a665-476b-9921-1a10363e40fd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.285645 Aug 31 11:11:29.052827 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 437/817] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:28 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:29.092074 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a7da466c-3745-400d-b5ad-79831f0b1465 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:29.092732 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a7da466c-3745-400d-b5ad-79831f0b1465 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:29.101142 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7da466c-3745-400d-b5ad-79831f0b1465 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:29.105124 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7da466c-3745-400d-b5ad-79831f0b1465 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:29.105401 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7da466c-3745-400d-b5ad-79831f0b1465 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:29.106343 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7da466c-3745-400d-b5ad-79831f0b1465 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:29.106776 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7da466c-3745-400d-b5ad-79831f0b1465 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:29.107185 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7da466c-3745-400d-b5ad-79831f0b1465 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:29.315292 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a7da466c-3745-400d-b5ad-79831f0b1465 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:29.317924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:29.327173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a7da466c-3745-400d-b5ad-79831f0b1465 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.239275 Aug 31 11:11:29.328103 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 438/818] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:29 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:29.334016 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-7fc6d76f-5fdf-4644-a6c4-aadda1b7ca1a req-56a217a0-947c-4861-8048-751ad697eb55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a86bd6-faab-4980-ac6b-19ecb1d2bf5b", "tag": "529be65a-b8c1-4b8d-b9bf-ef0a72d238ae"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:29.362572 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-7fc6d76f-5fdf-4644-a6c4-aadda1b7ca1a req-56a217a0-947c-4861-8048-751ad697eb55 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:29.363380 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-7fc6d76f-5fdf-4644-a6c4-aadda1b7ca1a req-56a217a0-947c-4861-8048-751ad697eb55 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:29.364214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-7fc6d76f-5fdf-4644-a6c4-aadda1b7ca1a req-56a217a0-947c-4861-8048-751ad697eb55 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:29.383325 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-7fc6d76f-5fdf-4644-a6c4-aadda1b7ca1a req-56a217a0-947c-4861-8048-751ad697eb55 service nova] Creating event network-changed:529be65a-b8c1-4b8d-b9bf-ef0a72d238ae for instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b on hv-cinder-85535 Aug 31 11:11:29.388084 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-7fc6d76f-5fdf-4644-a6c4-aadda1b7ca1a req-56a217a0-947c-4861-8048-751ad697eb55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058290 Aug 31 11:11:29.388685 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 439/819] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:11:29.448749 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a1abb828-64f0-45ea-8805-6e4d86868d31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:29.458138 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a1abb828-64f0-45ea-8805-6e4d86868d31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:29.459681 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a1abb828-64f0-45ea-8805-6e4d86868d31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:29.460962 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a1abb828-64f0-45ea-8805-6e4d86868d31 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1672 microversion: 2.20 time: 0.441903 Aug 31 11:11:29.461711 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 381/820] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:29 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1672 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:29.558551 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-805f73eb-9808-4993-86a1-030906fda213 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:29.559173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-805f73eb-9808-4993-86a1-030906fda213 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:29.565345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-805f73eb-9808-4993-86a1-030906fda213 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:29.565830 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-805f73eb-9808-4993-86a1-030906fda213 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:29.566260 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-805f73eb-9808-4993-86a1-030906fda213 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:29.566959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-805f73eb-9808-4993-86a1-030906fda213 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:29.567608 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-805f73eb-9808-4993-86a1-030906fda213 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:29.568233 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-805f73eb-9808-4993-86a1-030906fda213 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:29.642974 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-805f73eb-9808-4993-86a1-030906fda213 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:29.652714 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-805f73eb-9808-4993-86a1-030906fda213 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1295 microversion: 2.1 time: 0.098324 Aug 31 11:11:29.653536 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 440/821] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:29 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1295 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:30.072824 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a62613a1-ad88-4977-97c4-6b6c0c5da1f8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:30.073942 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a62613a1-ad88-4977-97c4-6b6c0c5da1f8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:30.082637 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a62613a1-ad88-4977-97c4-6b6c0c5da1f8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:30.083428 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a62613a1-ad88-4977-97c4-6b6c0c5da1f8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:30.084139 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a62613a1-ad88-4977-97c4-6b6c0c5da1f8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:30.085067 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a62613a1-ad88-4977-97c4-6b6c0c5da1f8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:30.085671 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a62613a1-ad88-4977-97c4-6b6c0c5da1f8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:30.085942 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a62613a1-ad88-4977-97c4-6b6c0c5da1f8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:30.355730 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9b9f46e1-5eed-43d4-a09c-bae3b4c13fd9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:30.356376 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9b9f46e1-5eed-43d4-a09c-bae3b4c13fd9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:30.365286 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9b9f46e1-5eed-43d4-a09c-bae3b4c13fd9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:30.365783 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9b9f46e1-5eed-43d4-a09c-bae3b4c13fd9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:30.366616 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9b9f46e1-5eed-43d4-a09c-bae3b4c13fd9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:30.367779 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9b9f46e1-5eed-43d4-a09c-bae3b4c13fd9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:30.369061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9b9f46e1-5eed-43d4-a09c-bae3b4c13fd9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:30.369689 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9b9f46e1-5eed-43d4-a09c-bae3b4c13fd9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:30.494126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a62613a1-ad88-4977-97c4-6b6c0c5da1f8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:30.512832 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a62613a1-ad88-4977-97c4-6b6c0c5da1f8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.444438 Aug 31 11:11:30.533093 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 382/822] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:30 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:30.541002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0f3c3508-f35f-4071-9d83-2fa3248c6751 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:30.541659 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0f3c3508-f35f-4071-9d83-2fa3248c6751 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:30.554211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:30.558517 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9b9f46e1-5eed-43d4-a09c-bae3b4c13fd9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:30.561105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f3c3508-f35f-4071-9d83-2fa3248c6751 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:30.564436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f3c3508-f35f-4071-9d83-2fa3248c6751 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:30.564999 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f3c3508-f35f-4071-9d83-2fa3248c6751 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:30.565749 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f3c3508-f35f-4071-9d83-2fa3248c6751 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:30.566217 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f3c3508-f35f-4071-9d83-2fa3248c6751 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:30.566673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0f3c3508-f35f-4071-9d83-2fa3248c6751 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:30.569756 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9b9f46e1-5eed-43d4-a09c-bae3b4c13fd9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.220414 Aug 31 11:11:30.570342 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 441/823] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:30 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:30.675587 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a056a19b-4317-455b-8ffd-1b851b62bab5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:30.676315 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a056a19b-4317-455b-8ffd-1b851b62bab5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:30.682257 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a056a19b-4317-455b-8ffd-1b851b62bab5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:30.682817 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a056a19b-4317-455b-8ffd-1b851b62bab5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:30.683376 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a056a19b-4317-455b-8ffd-1b851b62bab5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:30.684156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a056a19b-4317-455b-8ffd-1b851b62bab5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:30.684673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a056a19b-4317-455b-8ffd-1b851b62bab5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:30.685156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a056a19b-4317-455b-8ffd-1b851b62bab5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:30.853304 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a056a19b-4317-455b-8ffd-1b851b62bab5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:30.862417 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a056a19b-4317-455b-8ffd-1b851b62bab5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.191077 Aug 31 11:11:30.863009 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 442/824] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:30 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:31.293707 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0f3c3508-f35f-4071-9d83-2fa3248c6751 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:31.295162 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:31.304156 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0f3c3508-f35f-4071-9d83-2fa3248c6751 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:31.305614 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0f3c3508-f35f-4071-9d83-2fa3248c6751 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:31.306830 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0f3c3508-f35f-4071-9d83-2fa3248c6751 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.772422 Aug 31 11:11:31.307395 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 383/825] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:30 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:31.536923 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7d8db5d3-48bf-4fc0-96b9-4be52f7cbb7c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:31.537737 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7d8db5d3-48bf-4fc0-96b9-4be52f7cbb7c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:31.544654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d8db5d3-48bf-4fc0-96b9-4be52f7cbb7c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:31.545398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d8db5d3-48bf-4fc0-96b9-4be52f7cbb7c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:31.545831 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d8db5d3-48bf-4fc0-96b9-4be52f7cbb7c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:31.546574 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d8db5d3-48bf-4fc0-96b9-4be52f7cbb7c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:31.547189 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d8db5d3-48bf-4fc0-96b9-4be52f7cbb7c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:31.547619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7d8db5d3-48bf-4fc0-96b9-4be52f7cbb7c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:31.590895 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8621c40b-c463-46f3-89d7-cbbb52340511 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:31.592369 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8621c40b-c463-46f3-89d7-cbbb52340511 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:31.600277 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8621c40b-c463-46f3-89d7-cbbb52340511 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:31.601019 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8621c40b-c463-46f3-89d7-cbbb52340511 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:31.601715 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8621c40b-c463-46f3-89d7-cbbb52340511 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:31.602471 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8621c40b-c463-46f3-89d7-cbbb52340511 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:31.603126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8621c40b-c463-46f3-89d7-cbbb52340511 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:31.603548 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8621c40b-c463-46f3-89d7-cbbb52340511 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:31.697841 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7d8db5d3-48bf-4fc0-96b9-4be52f7cbb7c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:31.707493 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7d8db5d3-48bf-4fc0-96b9-4be52f7cbb7c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.175359 Aug 31 11:11:31.708421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 443/826] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:31 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:31.882810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ff5475b7-2850-4350-ac36-2c0897e95e2f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:31.883478 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ff5475b7-2850-4350-ac36-2c0897e95e2f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:31.889973 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ff5475b7-2850-4350-ac36-2c0897e95e2f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:31.890789 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ff5475b7-2850-4350-ac36-2c0897e95e2f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:31.891549 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ff5475b7-2850-4350-ac36-2c0897e95e2f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:31.892288 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ff5475b7-2850-4350-ac36-2c0897e95e2f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:31.892747 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ff5475b7-2850-4350-ac36-2c0897e95e2f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:31.893171 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ff5475b7-2850-4350-ac36-2c0897e95e2f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:32.040240 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ff5475b7-2850-4350-ac36-2c0897e95e2f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:32.050528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ff5475b7-2850-4350-ac36-2c0897e95e2f tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.171510 Aug 31 11:11:32.051602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 444/827] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:31 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:32.097634 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8621c40b-c463-46f3-89d7-cbbb52340511 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:32.107491 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8621c40b-c463-46f3-89d7-cbbb52340511 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.520472 Aug 31 11:11:32.110704 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 384/828] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:31 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:32.337153 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-31ec9b94-d5a3-42de-8d78-3fc4f8b1282a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:32.337775 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-31ec9b94-d5a3-42de-8d78-3fc4f8b1282a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:32.352820 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-31ec9b94-d5a3-42de-8d78-3fc4f8b1282a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:32.353237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-31ec9b94-d5a3-42de-8d78-3fc4f8b1282a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:32.353671 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-31ec9b94-d5a3-42de-8d78-3fc4f8b1282a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:32.354371 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-31ec9b94-d5a3-42de-8d78-3fc4f8b1282a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:32.355857 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-31ec9b94-d5a3-42de-8d78-3fc4f8b1282a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:32.356311 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-31ec9b94-d5a3-42de-8d78-3fc4f8b1282a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:32.503089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-9986c8d3-f252-4cb4-bb19-8aeeac97e84d req-28da6f5c-2070-41cc-b145-efc64bf72901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ae93cb-bdd8-4d6a-85f5-52918c72f87b", "tag": "2f72082c-c379-4dfa-8614-d7a320906f23"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:32.510872 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-31ec9b94-d5a3-42de-8d78-3fc4f8b1282a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:32.514541 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-9986c8d3-f252-4cb4-bb19-8aeeac97e84d req-28da6f5c-2070-41cc-b145-efc64bf72901 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:32.517097 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-9986c8d3-f252-4cb4-bb19-8aeeac97e84d req-28da6f5c-2070-41cc-b145-efc64bf72901 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:32.517711 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-9986c8d3-f252-4cb4-bb19-8aeeac97e84d req-28da6f5c-2070-41cc-b145-efc64bf72901 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:32.523928 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-31ec9b94-d5a3-42de-8d78-3fc4f8b1282a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:32.525853 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-31ec9b94-d5a3-42de-8d78-3fc4f8b1282a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:32.527020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-31ec9b94-d5a3-42de-8d78-3fc4f8b1282a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.194099 Aug 31 11:11:32.527579 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 445/829] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:32 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:32.541632 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-9986c8d3-f252-4cb4-bb19-8aeeac97e84d req-28da6f5c-2070-41cc-b145-efc64bf72901 service nova] Creating event network-changed:2f72082c-c379-4dfa-8614-d7a320906f23 for instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b on hv-cinder-85535 Aug 31 11:11:32.547444 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-9986c8d3-f252-4cb4-bb19-8aeeac97e84d req-28da6f5c-2070-41cc-b145-efc64bf72901 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049066 Aug 31 11:11:32.548072 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 385/830] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:11:32.728913 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1f83da2d-5000-4e00-82af-3c9bb05e8ca8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:32.729650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1f83da2d-5000-4e00-82af-3c9bb05e8ca8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:32.736837 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1f83da2d-5000-4e00-82af-3c9bb05e8ca8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:32.737320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1f83da2d-5000-4e00-82af-3c9bb05e8ca8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:32.737757 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1f83da2d-5000-4e00-82af-3c9bb05e8ca8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:32.738452 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1f83da2d-5000-4e00-82af-3c9bb05e8ca8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:32.738932 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1f83da2d-5000-4e00-82af-3c9bb05e8ca8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:32.739352 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1f83da2d-5000-4e00-82af-3c9bb05e8ca8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:32.888622 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-1f83da2d-5000-4e00-82af-3c9bb05e8ca8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:32.896683 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1f83da2d-5000-4e00-82af-3c9bb05e8ca8 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.171825 Aug 31 11:11:32.897260 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 446/831] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:32 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:33.073300 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8be20b82-dcc2-4185-884f-10a267663bc8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:33.073997 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8be20b82-dcc2-4185-884f-10a267663bc8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:33.080306 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8be20b82-dcc2-4185-884f-10a267663bc8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:33.080789 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8be20b82-dcc2-4185-884f-10a267663bc8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:33.081225 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8be20b82-dcc2-4185-884f-10a267663bc8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:33.081920 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8be20b82-dcc2-4185-884f-10a267663bc8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:33.082370 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8be20b82-dcc2-4185-884f-10a267663bc8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:33.082816 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8be20b82-dcc2-4185-884f-10a267663bc8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:33.130932 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6a433883-3112-4e68-b40a-80a16319e6fa tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:33.131540 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6a433883-3112-4e68-b40a-80a16319e6fa tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:33.137815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a433883-3112-4e68-b40a-80a16319e6fa tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:33.138229 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a433883-3112-4e68-b40a-80a16319e6fa tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:33.138672 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a433883-3112-4e68-b40a-80a16319e6fa tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:33.139401 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a433883-3112-4e68-b40a-80a16319e6fa tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:33.139851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a433883-3112-4e68-b40a-80a16319e6fa tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:33.140600 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a433883-3112-4e68-b40a-80a16319e6fa tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:33.225278 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8be20b82-dcc2-4185-884f-10a267663bc8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:33.233505 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8be20b82-dcc2-4185-884f-10a267663bc8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.164382 Aug 31 11:11:33.247829 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 386/832] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:33 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:33.287334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6a433883-3112-4e68-b40a-80a16319e6fa tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:33.299047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6a433883-3112-4e68-b40a-80a16319e6fa tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.171801 Aug 31 11:11:33.299631 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 447/833] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:33 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:33.551403 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-21c6ec7c-acdd-47bd-b062-b6c9c9cd992d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:33.552028 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-21c6ec7c-acdd-47bd-b062-b6c9c9cd992d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:33.557998 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-21c6ec7c-acdd-47bd-b062-b6c9c9cd992d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:33.558489 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-21c6ec7c-acdd-47bd-b062-b6c9c9cd992d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:33.558925 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-21c6ec7c-acdd-47bd-b062-b6c9c9cd992d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:33.559618 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-21c6ec7c-acdd-47bd-b062-b6c9c9cd992d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:33.560101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-21c6ec7c-acdd-47bd-b062-b6c9c9cd992d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:33.560532 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-21c6ec7c-acdd-47bd-b062-b6c9c9cd992d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:33.693799 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-21c6ec7c-acdd-47bd-b062-b6c9c9cd992d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:33.701940 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-21c6ec7c-acdd-47bd-b062-b6c9c9cd992d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:33.703385 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-21c6ec7c-acdd-47bd-b062-b6c9c9cd992d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:33.704583 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-21c6ec7c-acdd-47bd-b062-b6c9c9cd992d tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.157177 Aug 31 11:11:33.705147 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 387/834] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:33 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:33.917665 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-94d30859-eac9-42c4-8077-cfb15f8f8871 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:33.918271 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-94d30859-eac9-42c4-8077-cfb15f8f8871 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:33.920716 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:33.926824 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94d30859-eac9-42c4-8077-cfb15f8f8871 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:33.927310 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94d30859-eac9-42c4-8077-cfb15f8f8871 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:33.927741 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94d30859-eac9-42c4-8077-cfb15f8f8871 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:33.928459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94d30859-eac9-42c4-8077-cfb15f8f8871 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:33.928909 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94d30859-eac9-42c4-8077-cfb15f8f8871 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:33.929331 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-94d30859-eac9-42c4-8077-cfb15f8f8871 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:34.069800 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-94d30859-eac9-42c4-8077-cfb15f8f8871 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:34.078456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-94d30859-eac9-42c4-8077-cfb15f8f8871 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.164381 Aug 31 11:11:34.078966 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 448/835] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:33 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:34.255824 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-acc77701-39b0-4dce-a390-e809ea4112d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:34.256469 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-acc77701-39b0-4dce-a390-e809ea4112d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:34.263202 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-acc77701-39b0-4dce-a390-e809ea4112d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:34.263618 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-acc77701-39b0-4dce-a390-e809ea4112d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:34.264072 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-acc77701-39b0-4dce-a390-e809ea4112d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:34.264770 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-acc77701-39b0-4dce-a390-e809ea4112d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:34.265937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-acc77701-39b0-4dce-a390-e809ea4112d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:34.266376 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-acc77701-39b0-4dce-a390-e809ea4112d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:34.322277 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2a56bf2d-16bd-4f4b-b9b1-3e4645cb235c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:34.322911 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2a56bf2d-16bd-4f4b-b9b1-3e4645cb235c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:34.337955 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a56bf2d-16bd-4f4b-b9b1-3e4645cb235c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:34.338657 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a56bf2d-16bd-4f4b-b9b1-3e4645cb235c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:34.339184 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a56bf2d-16bd-4f4b-b9b1-3e4645cb235c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:34.339892 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a56bf2d-16bd-4f4b-b9b1-3e4645cb235c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:34.340408 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a56bf2d-16bd-4f4b-b9b1-3e4645cb235c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:34.341033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2a56bf2d-16bd-4f4b-b9b1-3e4645cb235c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:34.455477 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-acc77701-39b0-4dce-a390-e809ea4112d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:34.467744 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-acc77701-39b0-4dce-a390-e809ea4112d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.216106 Aug 31 11:11:34.468932 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 388/836] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:34 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:34.581201 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2a56bf2d-16bd-4f4b-b9b1-3e4645cb235c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:34.591490 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2a56bf2d-16bd-4f4b-b9b1-3e4645cb235c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.272936 Aug 31 11:11:34.604612 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 449/837] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:34 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:34.726891 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-7fc5a1ac-4652-4cd8-b9b3-542919e4ecb8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:34.727662 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-7fc5a1ac-4652-4cd8-b9b3-542919e4ecb8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:34.736853 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fc5a1ac-4652-4cd8-b9b3-542919e4ecb8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:34.737381 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fc5a1ac-4652-4cd8-b9b3-542919e4ecb8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:34.737829 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fc5a1ac-4652-4cd8-b9b3-542919e4ecb8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:34.738559 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fc5a1ac-4652-4cd8-b9b3-542919e4ecb8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:34.739230 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fc5a1ac-4652-4cd8-b9b3-542919e4ecb8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:34.739664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-7fc5a1ac-4652-4cd8-b9b3-542919e4ecb8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:34.901953 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:34.905435 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7fc5a1ac-4652-4cd8-b9b3-542919e4ecb8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:34.914738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7fc5a1ac-4652-4cd8-b9b3-542919e4ecb8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:34.916210 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-7fc5a1ac-4652-4cd8-b9b3-542919e4ecb8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:34.917367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-7fc5a1ac-4652-4cd8-b9b3-542919e4ecb8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.194401 Aug 31 11:11:34.933399 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 389/838] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:34 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:35.101280 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c1a96386-89aa-473a-b864-706901fe2a49 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:35.102505 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c1a96386-89aa-473a-b864-706901fe2a49 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:35.116267 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c1a96386-89aa-473a-b864-706901fe2a49 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:35.117158 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c1a96386-89aa-473a-b864-706901fe2a49 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:35.117865 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c1a96386-89aa-473a-b864-706901fe2a49 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:35.118750 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c1a96386-89aa-473a-b864-706901fe2a49 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:35.119435 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c1a96386-89aa-473a-b864-706901fe2a49 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:35.119823 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c1a96386-89aa-473a-b864-706901fe2a49 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:35.185026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-136d6b80-5e9e-4bfe-8be4-3d579152ba2f req-609a20c3-0f3d-47ad-b691-225034abfb65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2a8d50-fa16-40f4-9760-25603efd4d6d", "name": "network-vif-plugged", "status": "completed", "tag": "e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:35.205830 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-136d6b80-5e9e-4bfe-8be4-3d579152ba2f req-609a20c3-0f3d-47ad-b691-225034abfb65 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:35.206333 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-136d6b80-5e9e-4bfe-8be4-3d579152ba2f req-609a20c3-0f3d-47ad-b691-225034abfb65 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:35.206772 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-136d6b80-5e9e-4bfe-8be4-3d579152ba2f req-609a20c3-0f3d-47ad-b691-225034abfb65 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:35.226200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-136d6b80-5e9e-4bfe-8be4-3d579152ba2f req-609a20c3-0f3d-47ad-b691-225034abfb65 service nova] Creating event network-vif-plugged:e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13 for instance dd2a8d50-fa16-40f4-9760-25603efd4d6d on hv-cinder-85535 Aug 31 11:11:35.236399 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-136d6b80-5e9e-4bfe-8be4-3d579152ba2f req-609a20c3-0f3d-47ad-b691-225034abfb65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054957 Aug 31 11:11:35.237425 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 390/839] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:11:35.300033 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c1a96386-89aa-473a-b864-706901fe2a49 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:35.308442 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c1a96386-89aa-473a-b864-706901fe2a49 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.212584 Aug 31 11:11:35.309264 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 450/840] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:35 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:35.488830 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=8 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:35.493609 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-731e52eb-9f4d-4b4e-9b0c-f41d168ffbb3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:35.494330 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-731e52eb-9f4d-4b4e-9b0c-f41d168ffbb3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:35.501460 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-731e52eb-9f4d-4b4e-9b0c-f41d168ffbb3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:35.502043 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-731e52eb-9f4d-4b4e-9b0c-f41d168ffbb3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:35.502460 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-731e52eb-9f4d-4b4e-9b0c-f41d168ffbb3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:35.503184 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-731e52eb-9f4d-4b4e-9b0c-f41d168ffbb3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:35.503644 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-731e52eb-9f4d-4b4e-9b0c-f41d168ffbb3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:35.504286 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-731e52eb-9f4d-4b4e-9b0c-f41d168ffbb3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:35.614644 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8a6fdf5a-a14a-48eb-9000-c12ce712d8b4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:35.615279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8a6fdf5a-a14a-48eb-9000-c12ce712d8b4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:35.630434 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8a6fdf5a-a14a-48eb-9000-c12ce712d8b4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:35.631581 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8a6fdf5a-a14a-48eb-9000-c12ce712d8b4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:35.635148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8a6fdf5a-a14a-48eb-9000-c12ce712d8b4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:35.636582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8a6fdf5a-a14a-48eb-9000-c12ce712d8b4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:35.637230 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8a6fdf5a-a14a-48eb-9000-c12ce712d8b4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:35.637865 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8a6fdf5a-a14a-48eb-9000-c12ce712d8b4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:35.682947 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-731e52eb-9f4d-4b4e-9b0c-f41d168ffbb3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:35.693337 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-731e52eb-9f4d-4b4e-9b0c-f41d168ffbb3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.205940 Aug 31 11:11:35.707433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 391/841] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:35 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:35.806933 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8a6fdf5a-a14a-48eb-9000-c12ce712d8b4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:35.816625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8a6fdf5a-a14a-48eb-9000-c12ce712d8b4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.205745 Aug 31 11:11:35.817520 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 451/842] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:35 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:35.942100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e615c6e1-0644-406b-bbeb-06c0376ea6ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:35.943062 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e615c6e1-0644-406b-bbeb-06c0376ea6ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:35.949632 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e615c6e1-0644-406b-bbeb-06c0376ea6ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:35.950525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e615c6e1-0644-406b-bbeb-06c0376ea6ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:35.951285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e615c6e1-0644-406b-bbeb-06c0376ea6ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:35.952976 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e615c6e1-0644-406b-bbeb-06c0376ea6ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:35.953835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e615c6e1-0644-406b-bbeb-06c0376ea6ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:35.954327 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e615c6e1-0644-406b-bbeb-06c0376ea6ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:36.133331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e615c6e1-0644-406b-bbeb-06c0376ea6ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:36.144272 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e615c6e1-0644-406b-bbeb-06c0376ea6ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:36.145734 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e615c6e1-0644-406b-bbeb-06c0376ea6ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:36.146926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e615c6e1-0644-406b-bbeb-06c0376ea6ab tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.208838 Aug 31 11:11:36.147487 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 392/843] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:35 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:36.333457 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8e0949f3-366f-4ddc-9496-50e8c419aa37 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:36.334316 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8e0949f3-366f-4ddc-9496-50e8c419aa37 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:36.341235 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e0949f3-366f-4ddc-9496-50e8c419aa37 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:36.341899 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e0949f3-366f-4ddc-9496-50e8c419aa37 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:36.342378 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e0949f3-366f-4ddc-9496-50e8c419aa37 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:36.343838 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e0949f3-366f-4ddc-9496-50e8c419aa37 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:36.344404 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e0949f3-366f-4ddc-9496-50e8c419aa37 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:36.344975 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8e0949f3-366f-4ddc-9496-50e8c419aa37 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:36.490742 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8e0949f3-366f-4ddc-9496-50e8c419aa37 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:36.498873 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8e0949f3-366f-4ddc-9496-50e8c419aa37 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.172248 Aug 31 11:11:36.499675 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 452/844] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:36 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:36.715709 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-90bdc2ab-74e8-4e58-a070-75484b93dcae tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:36.716335 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-90bdc2ab-74e8-4e58-a070-75484b93dcae tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:36.724431 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90bdc2ab-74e8-4e58-a070-75484b93dcae tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:36.724918 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90bdc2ab-74e8-4e58-a070-75484b93dcae tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:36.725476 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90bdc2ab-74e8-4e58-a070-75484b93dcae tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:36.726178 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90bdc2ab-74e8-4e58-a070-75484b93dcae tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:36.726629 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90bdc2ab-74e8-4e58-a070-75484b93dcae tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:36.727146 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90bdc2ab-74e8-4e58-a070-75484b93dcae tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:36.839005 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6a09b889-8cbc-4d65-9543-30b5385a1fae tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:36.839789 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6a09b889-8cbc-4d65-9543-30b5385a1fae tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:36.846373 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a09b889-8cbc-4d65-9543-30b5385a1fae tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:36.847078 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a09b889-8cbc-4d65-9543-30b5385a1fae tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:36.847657 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a09b889-8cbc-4d65-9543-30b5385a1fae tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:36.848604 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a09b889-8cbc-4d65-9543-30b5385a1fae tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:36.850098 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a09b889-8cbc-4d65-9543-30b5385a1fae tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:36.853728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6a09b889-8cbc-4d65-9543-30b5385a1fae tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:36.886531 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-90bdc2ab-74e8-4e58-a070-75484b93dcae tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:36.896222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-90bdc2ab-74e8-4e58-a070-75484b93dcae tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.185389 Aug 31 11:11:36.897506 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 393/845] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:36 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:37.004679 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6a09b889-8cbc-4d65-9543-30b5385a1fae tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:37.013366 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6a09b889-8cbc-4d65-9543-30b5385a1fae tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.178155 Aug 31 11:11:37.014270 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 453/846] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:36 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:37.175078 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-41b8da0c-66fb-48bd-8120-6044b404eab7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:37.176349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-41b8da0c-66fb-48bd-8120-6044b404eab7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:37.182466 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41b8da0c-66fb-48bd-8120-6044b404eab7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:37.182966 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41b8da0c-66fb-48bd-8120-6044b404eab7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:37.183392 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41b8da0c-66fb-48bd-8120-6044b404eab7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:37.184121 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41b8da0c-66fb-48bd-8120-6044b404eab7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:37.184575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41b8da0c-66fb-48bd-8120-6044b404eab7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:37.184997 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-41b8da0c-66fb-48bd-8120-6044b404eab7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:37.369802 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-41b8da0c-66fb-48bd-8120-6044b404eab7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:37.379520 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-41b8da0c-66fb-48bd-8120-6044b404eab7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:37.382660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-41b8da0c-66fb-48bd-8120-6044b404eab7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:37.384579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-41b8da0c-66fb-48bd-8120-6044b404eab7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.214419 Aug 31 11:11:37.385702 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 394/847] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:37 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:37.520430 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-aaec0e88-4f17-4683-92b4-714f3e378549 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:37.521050 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-aaec0e88-4f17-4683-92b4-714f3e378549 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:37.523112 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:37.526579 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=12 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:37.531885 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-aaec0e88-4f17-4683-92b4-714f3e378549 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:37.532405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-aaec0e88-4f17-4683-92b4-714f3e378549 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:37.532847 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-aaec0e88-4f17-4683-92b4-714f3e378549 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:37.533845 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-aaec0e88-4f17-4683-92b4-714f3e378549 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:37.534285 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-aaec0e88-4f17-4683-92b4-714f3e378549 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:37.534721 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-aaec0e88-4f17-4683-92b4-714f3e378549 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:37.698402 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-aaec0e88-4f17-4683-92b4-714f3e378549 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:37.708431 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-aaec0e88-4f17-4683-92b4-714f3e378549 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.192616 Aug 31 11:11:37.709334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 454/848] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:37 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:37.918794 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0402408b-0333-4aee-9711-b495c220cb48 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:37.919412 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0402408b-0333-4aee-9711-b495c220cb48 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:37.926901 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0402408b-0333-4aee-9711-b495c220cb48 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:37.927657 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0402408b-0333-4aee-9711-b495c220cb48 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:37.928296 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0402408b-0333-4aee-9711-b495c220cb48 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:37.929162 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0402408b-0333-4aee-9711-b495c220cb48 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:37.929777 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0402408b-0333-4aee-9711-b495c220cb48 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:37.930361 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0402408b-0333-4aee-9711-b495c220cb48 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:38.036069 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6b3e821c-a2fd-4fbb-ab13-cc3737346f26 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:38.036955 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6b3e821c-a2fd-4fbb-ab13-cc3737346f26 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:38.044099 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6b3e821c-a2fd-4fbb-ab13-cc3737346f26 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:38.044959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6b3e821c-a2fd-4fbb-ab13-cc3737346f26 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:38.045620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6b3e821c-a2fd-4fbb-ab13-cc3737346f26 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:38.047289 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6b3e821c-a2fd-4fbb-ab13-cc3737346f26 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:38.048272 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6b3e821c-a2fd-4fbb-ab13-cc3737346f26 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:38.049124 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6b3e821c-a2fd-4fbb-ab13-cc3737346f26 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:38.069375 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0402408b-0333-4aee-9711-b495c220cb48 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:38.077070 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0402408b-0333-4aee-9711-b495c220cb48 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.162118 Aug 31 11:11:38.077951 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 395/849] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:37 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:38.195598 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6b3e821c-a2fd-4fbb-ab13-cc3737346f26 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:38.204244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6b3e821c-a2fd-4fbb-ab13-cc3737346f26 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.173199 Aug 31 11:11:38.205173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 455/850] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:38 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:38.410420 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-86539fd1-3b8a-40ce-b86b-784acdc23581 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:38.411698 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-86539fd1-3b8a-40ce-b86b-784acdc23581 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:38.417847 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86539fd1-3b8a-40ce-b86b-784acdc23581 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:38.418334 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86539fd1-3b8a-40ce-b86b-784acdc23581 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:38.418769 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86539fd1-3b8a-40ce-b86b-784acdc23581 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:38.419477 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86539fd1-3b8a-40ce-b86b-784acdc23581 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:38.419928 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86539fd1-3b8a-40ce-b86b-784acdc23581 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:38.420377 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86539fd1-3b8a-40ce-b86b-784acdc23581 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:38.599187 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-86539fd1-3b8a-40ce-b86b-784acdc23581 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:38.607960 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-86539fd1-3b8a-40ce-b86b-784acdc23581 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:38.609989 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-86539fd1-3b8a-40ce-b86b-784acdc23581 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:38.611604 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-86539fd1-3b8a-40ce-b86b-784acdc23581 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.205717 Aug 31 11:11:38.612587 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 396/851] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:38 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:11:38.728759 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e34eb98a-e946-4a42-83e2-c67cb0414d33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:38.729953 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e34eb98a-e946-4a42-83e2-c67cb0414d33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:38.736630 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e34eb98a-e946-4a42-83e2-c67cb0414d33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:38.737354 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e34eb98a-e946-4a42-83e2-c67cb0414d33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:38.737975 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e34eb98a-e946-4a42-83e2-c67cb0414d33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:38.738945 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e34eb98a-e946-4a42-83e2-c67cb0414d33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:38.739630 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e34eb98a-e946-4a42-83e2-c67cb0414d33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:38.740312 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e34eb98a-e946-4a42-83e2-c67cb0414d33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:38.745642 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=100 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:38.778111 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a424e513-053f-4411-877c-c5830081657b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:38.778932 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a424e513-053f-4411-877c-c5830081657b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:38.792044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a424e513-053f-4411-877c-c5830081657b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:38.796774 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a424e513-053f-4411-877c-c5830081657b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:38.797861 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a424e513-053f-4411-877c-c5830081657b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:38.798983 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a424e513-053f-4411-877c-c5830081657b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:38.799661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a424e513-053f-4411-877c-c5830081657b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:38.800415 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a424e513-053f-4411-877c-c5830081657b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:38.835404 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a424e513-053f-4411-877c-c5830081657b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/ips" status: 200 len: 147 microversion: 2.1 time: 0.065784 Aug 31 11:11:38.843213 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 397/852] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 11:11:38 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/ips => generated 147 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:11:38.971055 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e34eb98a-e946-4a42-83e2-c67cb0414d33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:38.980859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e34eb98a-e946-4a42-83e2-c67cb0414d33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.255733 Aug 31 11:11:38.985250 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 456/853] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:38 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:39.100417 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8037ae2a-41b0-4781-8a78-992f445862dc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:39.101811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8037ae2a-41b0-4781-8a78-992f445862dc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:39.116386 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8037ae2a-41b0-4781-8a78-992f445862dc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:39.118099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8037ae2a-41b0-4781-8a78-992f445862dc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:39.118795 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8037ae2a-41b0-4781-8a78-992f445862dc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:39.122096 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8037ae2a-41b0-4781-8a78-992f445862dc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:39.123760 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8037ae2a-41b0-4781-8a78-992f445862dc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:39.124399 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8037ae2a-41b0-4781-8a78-992f445862dc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:39.231716 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d6c8e460-0826-438c-ba77-3784e3f57dce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:39.232604 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d6c8e460-0826-438c-ba77-3784e3f57dce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:39.255177 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6c8e460-0826-438c-ba77-3784e3f57dce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:39.260833 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6c8e460-0826-438c-ba77-3784e3f57dce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:39.262364 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6c8e460-0826-438c-ba77-3784e3f57dce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:39.265674 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6c8e460-0826-438c-ba77-3784e3f57dce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:39.266188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6c8e460-0826-438c-ba77-3784e3f57dce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:39.266634 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6c8e460-0826-438c-ba77-3784e3f57dce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:39.501384 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8037ae2a-41b0-4781-8a78-992f445862dc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:39.509955 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8037ae2a-41b0-4781-8a78-992f445862dc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.415396 Aug 31 11:11:39.529483 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 398/854] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:39 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:39.639038 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-14d16104-5bf7-432c-ba3b-1e91a71dddb3 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:39.639920 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-14d16104-5bf7-432c-ba3b-1e91a71dddb3 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:39.652543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-14d16104-5bf7-432c-ba3b-1e91a71dddb3 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:39.653866 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-14d16104-5bf7-432c-ba3b-1e91a71dddb3 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:39.654983 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-14d16104-5bf7-432c-ba3b-1e91a71dddb3 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:39.657506 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-14d16104-5bf7-432c-ba3b-1e91a71dddb3 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:39.658440 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-14d16104-5bf7-432c-ba3b-1e91a71dddb3 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:39.660408 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-14d16104-5bf7-432c-ba3b-1e91a71dddb3 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:39.679936 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d6c8e460-0826-438c-ba77-3784e3f57dce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:39.706427 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d6c8e460-0826-438c-ba77-3784e3f57dce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.483444 Aug 31 11:11:39.709197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 457/855] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:39 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:39.935684 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-14d16104-5bf7-432c-ba3b-1e91a71dddb3 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:39.951481 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-14d16104-5bf7-432c-ba3b-1e91a71dddb3 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:39.955161 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-14d16104-5bf7-432c-ba3b-1e91a71dddb3 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:39.956888 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-14d16104-5bf7-432c-ba3b-1e91a71dddb3 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.321975 Aug 31 11:11:39.957989 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 399/856] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:39 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:40.006594 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5a1e0375-1f32-4569-895d-0a9d74a36f2b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:40.007219 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5a1e0375-1f32-4569-895d-0a9d74a36f2b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:40.014445 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5a1e0375-1f32-4569-895d-0a9d74a36f2b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:40.015338 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5a1e0375-1f32-4569-895d-0a9d74a36f2b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:40.016767 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5a1e0375-1f32-4569-895d-0a9d74a36f2b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:40.017793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5a1e0375-1f32-4569-895d-0a9d74a36f2b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:40.018425 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5a1e0375-1f32-4569-895d-0a9d74a36f2b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:40.019052 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5a1e0375-1f32-4569-895d-0a9d74a36f2b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:40.223149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-5a1e0375-1f32-4569-895d-0a9d74a36f2b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:40.233320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-5a1e0375-1f32-4569-895d-0a9d74a36f2b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.231057 Aug 31 11:11:40.240701 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 458/857] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:40 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:40.413113 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3e7cdaf9-e46a-4dc4-bdce-a0b8682fca9d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a5427bc-a258-4219-8d4d-2958b4616428"}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:40.415936 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3e7cdaf9-e46a-4dc4-bdce-a0b8682fca9d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:40.427699 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e7cdaf9-e46a-4dc4-bdce-a0b8682fca9d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:40.428246 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e7cdaf9-e46a-4dc4-bdce-a0b8682fca9d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:40.428698 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e7cdaf9-e46a-4dc4-bdce-a0b8682fca9d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:40.429644 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e7cdaf9-e46a-4dc4-bdce-a0b8682fca9d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:40.430933 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e7cdaf9-e46a-4dc4-bdce-a0b8682fca9d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:40.431395 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e7cdaf9-e46a-4dc4-bdce-a0b8682fca9d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:40.535678 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7bd97f6f-d231-4ce4-a088-9e05b8466547 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:40.540864 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7bd97f6f-d231-4ce4-a088-9e05b8466547 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:40.552660 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bd97f6f-d231-4ce4-a088-9e05b8466547 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:40.553636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bd97f6f-d231-4ce4-a088-9e05b8466547 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:40.554112 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bd97f6f-d231-4ce4-a088-9e05b8466547 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:40.554859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bd97f6f-d231-4ce4-a088-9e05b8466547 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:40.555382 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bd97f6f-d231-4ce4-a088-9e05b8466547 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:40.556076 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7bd97f6f-d231-4ce4-a088-9e05b8466547 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:40.782059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7bd97f6f-d231-4ce4-a088-9e05b8466547 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:40.791871 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7bd97f6f-d231-4ce4-a088-9e05b8466547 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.262007 Aug 31 11:11:40.792897 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 459/858] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:40 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:40.806709 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b98100e0-21fd-4df1-bd5e-5c8c2d1d36ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:40.807334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b98100e0-21fd-4df1-bd5e-5c8c2d1d36ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:40.814245 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b98100e0-21fd-4df1-bd5e-5c8c2d1d36ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:40.814735 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b98100e0-21fd-4df1-bd5e-5c8c2d1d36ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:40.815204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b98100e0-21fd-4df1-bd5e-5c8c2d1d36ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:40.815910 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b98100e0-21fd-4df1-bd5e-5c8c2d1d36ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:40.816388 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b98100e0-21fd-4df1-bd5e-5c8c2d1d36ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:40.817065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b98100e0-21fd-4df1-bd5e-5c8c2d1d36ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:41.011375 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b98100e0-21fd-4df1-bd5e-5c8c2d1d36ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:41.020266 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b98100e0-21fd-4df1-bd5e-5c8c2d1d36ee tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.226112 Aug 31 11:11:41.034123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 460/859] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:40 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:41.039264 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d692b468-7c7f-4f8c-88a3-4f581f643c38 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:41.039748 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d692b468-7c7f-4f8c-88a3-4f581f643c38 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:41.048261 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d692b468-7c7f-4f8c-88a3-4f581f643c38 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:41.049213 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d692b468-7c7f-4f8c-88a3-4f581f643c38 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:41.049816 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d692b468-7c7f-4f8c-88a3-4f581f643c38 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:41.050707 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d692b468-7c7f-4f8c-88a3-4f581f643c38 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:41.051411 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d692b468-7c7f-4f8c-88a3-4f581f643c38 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:41.052089 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d692b468-7c7f-4f8c-88a3-4f581f643c38 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:41.226926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d692b468-7c7f-4f8c-88a3-4f581f643c38 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:41.236888 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d692b468-7c7f-4f8c-88a3-4f581f643c38 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:41.238760 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d692b468-7c7f-4f8c-88a3-4f581f643c38 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:41.240157 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d692b468-7c7f-4f8c-88a3-4f581f643c38 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.204809 Aug 31 11:11:41.241306 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 461/860] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:41 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:41.255656 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fc3a3931-e680-4b72-8b42-b1c87fae7033 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:41.256603 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fc3a3931-e680-4b72-8b42-b1c87fae7033 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:41.264964 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fc3a3931-e680-4b72-8b42-b1c87fae7033 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:41.265949 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fc3a3931-e680-4b72-8b42-b1c87fae7033 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:41.266366 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fc3a3931-e680-4b72-8b42-b1c87fae7033 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:41.267071 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fc3a3931-e680-4b72-8b42-b1c87fae7033 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:41.267513 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fc3a3931-e680-4b72-8b42-b1c87fae7033 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:41.267966 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fc3a3931-e680-4b72-8b42-b1c87fae7033 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:41.468596 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fc3a3931-e680-4b72-8b42-b1c87fae7033 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:41.476942 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fc3a3931-e680-4b72-8b42-b1c87fae7033 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.226172 Aug 31 11:11:41.480048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 462/861] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:41 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:41.813603 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-24e67da6-bab9-4e22-87e2-ea3ce730b65d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:41.814359 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-24e67da6-bab9-4e22-87e2-ea3ce730b65d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:41.824395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-24e67da6-bab9-4e22-87e2-ea3ce730b65d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:41.836502 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-24e67da6-bab9-4e22-87e2-ea3ce730b65d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:41.837794 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-24e67da6-bab9-4e22-87e2-ea3ce730b65d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:41.838769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-24e67da6-bab9-4e22-87e2-ea3ce730b65d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:41.847237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-24e67da6-bab9-4e22-87e2-ea3ce730b65d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:41.848262 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-24e67da6-bab9-4e22-87e2-ea3ce730b65d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:42.018615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-24e67da6-bab9-4e22-87e2-ea3ce730b65d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:42.027304 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-24e67da6-bab9-4e22-87e2-ea3ce730b65d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.218076 Aug 31 11:11:42.029295 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 463/862] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:41 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:42.050098 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9101975e-8d35-4a6e-b10c-b40d1cd0abbf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:42.052527 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9101975e-8d35-4a6e-b10c-b40d1cd0abbf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:42.059375 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9101975e-8d35-4a6e-b10c-b40d1cd0abbf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:42.060211 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9101975e-8d35-4a6e-b10c-b40d1cd0abbf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:42.060907 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9101975e-8d35-4a6e-b10c-b40d1cd0abbf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:42.061853 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9101975e-8d35-4a6e-b10c-b40d1cd0abbf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:42.062564 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9101975e-8d35-4a6e-b10c-b40d1cd0abbf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:42.063298 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9101975e-8d35-4a6e-b10c-b40d1cd0abbf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:42.253140 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9101975e-8d35-4a6e-b10c-b40d1cd0abbf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:42.262546 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9101975e-8d35-4a6e-b10c-b40d1cd0abbf tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.216792 Aug 31 11:11:42.276768 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 464/863] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:42 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:42.283801 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6e970a92-bdb0-4954-8e06-317f3b014bc9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:42.284438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6e970a92-bdb0-4954-8e06-317f3b014bc9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:42.290475 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6e970a92-bdb0-4954-8e06-317f3b014bc9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:42.290960 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6e970a92-bdb0-4954-8e06-317f3b014bc9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:42.291399 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6e970a92-bdb0-4954-8e06-317f3b014bc9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:42.292133 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6e970a92-bdb0-4954-8e06-317f3b014bc9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:42.292590 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6e970a92-bdb0-4954-8e06-317f3b014bc9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:42.293034 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6e970a92-bdb0-4954-8e06-317f3b014bc9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:42.445723 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6e970a92-bdb0-4954-8e06-317f3b014bc9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:42.454976 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6e970a92-bdb0-4954-8e06-317f3b014bc9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:42.456806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-6e970a92-bdb0-4954-8e06-317f3b014bc9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:42.458273 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6e970a92-bdb0-4954-8e06-317f3b014bc9 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.179997 Aug 31 11:11:42.459061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 465/864] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:42 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:42.498156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-930a8fe1-1d5b-4ec6-96da-4214360786f7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:42.498793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-930a8fe1-1d5b-4ec6-96da-4214360786f7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:42.505081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-930a8fe1-1d5b-4ec6-96da-4214360786f7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:42.505800 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-930a8fe1-1d5b-4ec6-96da-4214360786f7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:42.506463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-930a8fe1-1d5b-4ec6-96da-4214360786f7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:42.507356 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-930a8fe1-1d5b-4ec6-96da-4214360786f7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:42.507882 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-930a8fe1-1d5b-4ec6-96da-4214360786f7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:42.508704 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-930a8fe1-1d5b-4ec6-96da-4214360786f7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:42.708318 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-930a8fe1-1d5b-4ec6-96da-4214360786f7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:42.718125 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-930a8fe1-1d5b-4ec6-96da-4214360786f7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.223695 Aug 31 11:11:42.719482 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 466/865] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:42 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:43.050867 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-92a659af-c144-4df9-a427-3e58d54f687c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:43.051514 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-92a659af-c144-4df9-a427-3e58d54f687c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:43.058007 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-92a659af-c144-4df9-a427-3e58d54f687c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:43.058495 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-92a659af-c144-4df9-a427-3e58d54f687c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:43.058933 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-92a659af-c144-4df9-a427-3e58d54f687c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:43.059635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-92a659af-c144-4df9-a427-3e58d54f687c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:43.060116 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-92a659af-c144-4df9-a427-3e58d54f687c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:43.060546 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-92a659af-c144-4df9-a427-3e58d54f687c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:43.424235 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-92a659af-c144-4df9-a427-3e58d54f687c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:43.433395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-92a659af-c144-4df9-a427-3e58d54f687c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.386940 Aug 31 11:11:43.434350 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 467/866] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:43 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:43.448427 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b7d5ca7e-c13d-44cc-ab7a-2834c8d1604e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:43.449282 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b7d5ca7e-c13d-44cc-ab7a-2834c8d1604e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:43.457270 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b7d5ca7e-c13d-44cc-ab7a-2834c8d1604e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:43.457859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b7d5ca7e-c13d-44cc-ab7a-2834c8d1604e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:43.458363 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b7d5ca7e-c13d-44cc-ab7a-2834c8d1604e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:43.459673 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b7d5ca7e-c13d-44cc-ab7a-2834c8d1604e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:43.460314 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b7d5ca7e-c13d-44cc-ab7a-2834c8d1604e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:43.460792 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b7d5ca7e-c13d-44cc-ab7a-2834c8d1604e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:43.622002 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b7d5ca7e-c13d-44cc-ab7a-2834c8d1604e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:43.629871 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b7d5ca7e-c13d-44cc-ab7a-2834c8d1604e tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.194471 Aug 31 11:11:43.630446 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 468/867] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:43 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:43.635111 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f754332d-6ee4-431d-b2b6-0116dce4c632 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:43.635714 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f754332d-6ee4-431d-b2b6-0116dce4c632 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:43.641916 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f754332d-6ee4-431d-b2b6-0116dce4c632 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:43.642403 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f754332d-6ee4-431d-b2b6-0116dce4c632 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:43.642840 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f754332d-6ee4-431d-b2b6-0116dce4c632 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:43.643546 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f754332d-6ee4-431d-b2b6-0116dce4c632 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:43.644205 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f754332d-6ee4-431d-b2b6-0116dce4c632 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:43.644640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f754332d-6ee4-431d-b2b6-0116dce4c632 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:43.795253 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f754332d-6ee4-431d-b2b6-0116dce4c632 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:43.805103 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f754332d-6ee4-431d-b2b6-0116dce4c632 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:43.806877 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f754332d-6ee4-431d-b2b6-0116dce4c632 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:43.808167 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f754332d-6ee4-431d-b2b6-0116dce4c632 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.176593 Aug 31 11:11:43.808800 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 469/868] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:43 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:43.813974 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f1f66a09-0648-4030-9577-b01615e693b3 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:43.814654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f1f66a09-0648-4030-9577-b01615e693b3 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:43.821020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f1f66a09-0648-4030-9577-b01615e693b3 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:43.821591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f1f66a09-0648-4030-9577-b01615e693b3 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:43.822238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f1f66a09-0648-4030-9577-b01615e693b3 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:43.823002 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f1f66a09-0648-4030-9577-b01615e693b3 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:43.823666 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f1f66a09-0648-4030-9577-b01615e693b3 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:43.828710 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f1f66a09-0648-4030-9577-b01615e693b3 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:43.970065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f1f66a09-0648-4030-9577-b01615e693b3 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:43.977951 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f1f66a09-0648-4030-9577-b01615e693b3 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.167953 Aug 31 11:11:43.978979 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 470/869] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:43 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:44.409159 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:44.421209 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3e7cdaf9-e46a-4dc4-bdce-a0b8682fca9d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "POST /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.012141 Aug 31 11:11:44.421831 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 400/870] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:11:40 2022] POST /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/os-volume_attachments => generated 194 bytes in 4014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:11:44.457382 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b931f8f8-5ab8-4f77-8b9a-c5223621bba3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:44.459129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b931f8f8-5ab8-4f77-8b9a-c5223621bba3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:44.467030 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b931f8f8-5ab8-4f77-8b9a-c5223621bba3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:44.467572 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b931f8f8-5ab8-4f77-8b9a-c5223621bba3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:44.469059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b931f8f8-5ab8-4f77-8b9a-c5223621bba3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:44.470037 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b931f8f8-5ab8-4f77-8b9a-c5223621bba3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:44.470902 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b931f8f8-5ab8-4f77-8b9a-c5223621bba3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:44.471707 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b931f8f8-5ab8-4f77-8b9a-c5223621bba3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:44.645419 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b931f8f8-5ab8-4f77-8b9a-c5223621bba3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:44.652202 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a14f8019-b851-4179-b9da-90c9c3ee25a4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:44.653051 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a14f8019-b851-4179-b9da-90c9c3ee25a4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:44.654980 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b931f8f8-5ab8-4f77-8b9a-c5223621bba3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.202613 Aug 31 11:11:44.656163 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 471/871] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:44 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:44.660532 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a14f8019-b851-4179-b9da-90c9c3ee25a4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:44.661095 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a14f8019-b851-4179-b9da-90c9c3ee25a4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:44.661602 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a14f8019-b851-4179-b9da-90c9c3ee25a4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:44.662367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a14f8019-b851-4179-b9da-90c9c3ee25a4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:44.663235 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a14f8019-b851-4179-b9da-90c9c3ee25a4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:44.663376 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a14f8019-b851-4179-b9da-90c9c3ee25a4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:44.831974 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-09a26c4e-1d5e-4221-96a2-2743731c7f02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:44.832696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-09a26c4e-1d5e-4221-96a2-2743731c7f02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:44.838814 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-09a26c4e-1d5e-4221-96a2-2743731c7f02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:44.839230 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-09a26c4e-1d5e-4221-96a2-2743731c7f02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:44.839661 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-09a26c4e-1d5e-4221-96a2-2743731c7f02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:44.840391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-09a26c4e-1d5e-4221-96a2-2743731c7f02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:44.840837 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-09a26c4e-1d5e-4221-96a2-2743731c7f02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:44.841260 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-09a26c4e-1d5e-4221-96a2-2743731c7f02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:44.851048 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a14f8019-b851-4179-b9da-90c9c3ee25a4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:44.859868 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a14f8019-b851-4179-b9da-90c9c3ee25a4 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1575 microversion: 2.1 time: 0.212702 Aug 31 11:11:44.860499 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 401/872] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:44 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:44.982822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-09a26c4e-1d5e-4221-96a2-2743731c7f02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:44.985258 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=100 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:44.992454 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-09a26c4e-1d5e-4221-96a2-2743731c7f02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:44.994320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-09a26c4e-1d5e-4221-96a2-2743731c7f02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:44.995661 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-09a26c4e-1d5e-4221-96a2-2743731c7f02 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.168375 Aug 31 11:11:44.996234 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 472/873] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:44 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:11:44.998749 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0129e2c1-077e-45b9-992b-7fdb4776e0e6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:44.999704 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0129e2c1-077e-45b9-992b-7fdb4776e0e6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:45.006111 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0129e2c1-077e-45b9-992b-7fdb4776e0e6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:45.006589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0129e2c1-077e-45b9-992b-7fdb4776e0e6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:45.007017 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0129e2c1-077e-45b9-992b-7fdb4776e0e6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:45.007990 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0129e2c1-077e-45b9-992b-7fdb4776e0e6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:45.008206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0129e2c1-077e-45b9-992b-7fdb4776e0e6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:45.008825 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0129e2c1-077e-45b9-992b-7fdb4776e0e6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:45.144809 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0129e2c1-077e-45b9-992b-7fdb4776e0e6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:45.152953 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0129e2c1-077e-45b9-992b-7fdb4776e0e6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.158003 Aug 31 11:11:45.153549 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 402/874] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:44 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:45.677413 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2dca0f82-9df9-4af5-a5e3-dd52b49940b2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:45.678013 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2dca0f82-9df9-4af5-a5e3-dd52b49940b2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:45.684539 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2dca0f82-9df9-4af5-a5e3-dd52b49940b2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:45.685019 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2dca0f82-9df9-4af5-a5e3-dd52b49940b2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:45.685451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2dca0f82-9df9-4af5-a5e3-dd52b49940b2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:45.686142 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2dca0f82-9df9-4af5-a5e3-dd52b49940b2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:45.686583 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2dca0f82-9df9-4af5-a5e3-dd52b49940b2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:45.687679 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2dca0f82-9df9-4af5-a5e3-dd52b49940b2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:45.816483 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2dca0f82-9df9-4af5-a5e3-dd52b49940b2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:45.824025 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2dca0f82-9df9-4af5-a5e3-dd52b49940b2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.150542 Aug 31 11:11:45.824580 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 473/875] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:45 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:45.881095 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-14d65fd0-e9df-4a69-8d26-3bdacc20f42c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:45.881664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-14d65fd0-e9df-4a69-8d26-3bdacc20f42c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:45.888074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-14d65fd0-e9df-4a69-8d26-3bdacc20f42c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:45.888550 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-14d65fd0-e9df-4a69-8d26-3bdacc20f42c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:45.888979 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-14d65fd0-e9df-4a69-8d26-3bdacc20f42c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:45.889687 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-14d65fd0-e9df-4a69-8d26-3bdacc20f42c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:45.890165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-14d65fd0-e9df-4a69-8d26-3bdacc20f42c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:45.890741 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-14d65fd0-e9df-4a69-8d26-3bdacc20f42c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:46.017889 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4f34f349-b8ce-4783-9236-2a881926eec7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:46.018515 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4f34f349-b8ce-4783-9236-2a881926eec7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:46.021469 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-14d65fd0-e9df-4a69-8d26-3bdacc20f42c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:46.024832 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f34f349-b8ce-4783-9236-2a881926eec7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:46.025323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f34f349-b8ce-4783-9236-2a881926eec7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:46.025759 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f34f349-b8ce-4783-9236-2a881926eec7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:46.026463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f34f349-b8ce-4783-9236-2a881926eec7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:46.026917 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f34f349-b8ce-4783-9236-2a881926eec7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:46.027342 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f34f349-b8ce-4783-9236-2a881926eec7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:46.029837 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-14d65fd0-e9df-4a69-8d26-3bdacc20f42c tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1562 microversion: 2.1 time: 0.152632 Aug 31 11:11:46.030413 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 403/876] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:45 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:46.162082 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4f34f349-b8ce-4783-9236-2a881926eec7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:46.171170 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4f34f349-b8ce-4783-9236-2a881926eec7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:46.173511 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4f34f349-b8ce-4783-9236-2a881926eec7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:46.174812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4f34f349-b8ce-4783-9236-2a881926eec7 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.160860 Aug 31 11:11:46.179740 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 474/877] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:46 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:11:46.179940 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-712b672e-6cdf-4605-9c9c-856fd03cbb8b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:46.179940 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-712b672e-6cdf-4605-9c9c-856fd03cbb8b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:46.182604 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-712b672e-6cdf-4605-9c9c-856fd03cbb8b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:46.183159 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-712b672e-6cdf-4605-9c9c-856fd03cbb8b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:46.183670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-712b672e-6cdf-4605-9c9c-856fd03cbb8b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:46.184471 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-712b672e-6cdf-4605-9c9c-856fd03cbb8b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:46.184997 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-712b672e-6cdf-4605-9c9c-856fd03cbb8b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:46.185491 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-712b672e-6cdf-4605-9c9c-856fd03cbb8b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:46.325762 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-712b672e-6cdf-4605-9c9c-856fd03cbb8b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:46.333840 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-712b672e-6cdf-4605-9c9c-856fd03cbb8b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.163715 Aug 31 11:11:46.334407 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 404/878] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:46 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:46.439288 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-54aae881-4f42-4229-9f25-eb9e924bd166 req-f5cb472b-3c17-420a-937e-618b34fb0272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a86bd6-faab-4980-ac6b-19ecb1d2bf5b", "name": "network-vif-plugged", "status": "completed", "tag": "529be65a-b8c1-4b8d-b9bf-ef0a72d238ae"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:46.448880 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-54aae881-4f42-4229-9f25-eb9e924bd166 req-f5cb472b-3c17-420a-937e-618b34fb0272 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:46.449449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-54aae881-4f42-4229-9f25-eb9e924bd166 req-f5cb472b-3c17-420a-937e-618b34fb0272 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:46.449949 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-54aae881-4f42-4229-9f25-eb9e924bd166 req-f5cb472b-3c17-420a-937e-618b34fb0272 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:46.465274 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-54aae881-4f42-4229-9f25-eb9e924bd166 req-f5cb472b-3c17-420a-937e-618b34fb0272 service nova] Creating event network-vif-plugged:529be65a-b8c1-4b8d-b9bf-ef0a72d238ae for instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b on hv-cinder-85535 Aug 31 11:11:46.471215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-54aae881-4f42-4229-9f25-eb9e924bd166 req-f5cb472b-3c17-420a-937e-618b34fb0272 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035913 Aug 31 11:11:46.471813 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 475/879] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:11:46.843853 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ddfec84b-662c-4776-96b2-869759bb11da tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:46.844599 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ddfec84b-662c-4776-96b2-869759bb11da tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:46.851078 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ddfec84b-662c-4776-96b2-869759bb11da tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:46.851562 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ddfec84b-662c-4776-96b2-869759bb11da tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:46.851999 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ddfec84b-662c-4776-96b2-869759bb11da tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:46.852725 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ddfec84b-662c-4776-96b2-869759bb11da tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:46.853212 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ddfec84b-662c-4776-96b2-869759bb11da tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:46.853638 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ddfec84b-662c-4776-96b2-869759bb11da tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:46.993319 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ddfec84b-662c-4776-96b2-869759bb11da tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:47.005192 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ddfec84b-662c-4776-96b2-869759bb11da tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.165380 Aug 31 11:11:47.005774 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 405/880] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:46 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:47.198246 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8fba14b9-0ba3-4e3e-8029-12c87adbcc63 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:47.198866 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8fba14b9-0ba3-4e3e-8029-12c87adbcc63 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:47.205533 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8fba14b9-0ba3-4e3e-8029-12c87adbcc63 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:47.206041 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8fba14b9-0ba3-4e3e-8029-12c87adbcc63 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:47.206472 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8fba14b9-0ba3-4e3e-8029-12c87adbcc63 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:47.207148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8fba14b9-0ba3-4e3e-8029-12c87adbcc63 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:47.207594 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8fba14b9-0ba3-4e3e-8029-12c87adbcc63 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:47.208034 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8fba14b9-0ba3-4e3e-8029-12c87adbcc63 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:47.355926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-16f65189-87f5-4778-a238-d16a3dab9499 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:47.356564 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-16f65189-87f5-4778-a238-d16a3dab9499 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:47.363411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-16f65189-87f5-4778-a238-d16a3dab9499 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:47.363899 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-16f65189-87f5-4778-a238-d16a3dab9499 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:47.364368 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-16f65189-87f5-4778-a238-d16a3dab9499 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:47.365066 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-16f65189-87f5-4778-a238-d16a3dab9499 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:47.365511 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-16f65189-87f5-4778-a238-d16a3dab9499 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:47.365932 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-16f65189-87f5-4778-a238-d16a3dab9499 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:47.413020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8fba14b9-0ba3-4e3e-8029-12c87adbcc63 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:47.422152 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8fba14b9-0ba3-4e3e-8029-12c87adbcc63 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:47.423778 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8fba14b9-0ba3-4e3e-8029-12c87adbcc63 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:47.424972 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8fba14b9-0ba3-4e3e-8029-12c87adbcc63 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.231029 Aug 31 11:11:47.425526 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 476/881] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:47 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:47.506470 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-16f65189-87f5-4778-a238-d16a3dab9499 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:47.514004 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-16f65189-87f5-4778-a238-d16a3dab9499 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1265 microversion: 2.1 time: 0.162731 Aug 31 11:11:47.514564 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 406/882] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:47 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:48.026708 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-10736068-eb76-4e07-adfb-20a8ac8a8f0d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:48.027318 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-10736068-eb76-4e07-adfb-20a8ac8a8f0d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:48.034120 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-10736068-eb76-4e07-adfb-20a8ac8a8f0d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:48.034629 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-10736068-eb76-4e07-adfb-20a8ac8a8f0d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:48.035067 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-10736068-eb76-4e07-adfb-20a8ac8a8f0d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:48.035753 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-10736068-eb76-4e07-adfb-20a8ac8a8f0d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:48.036240 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-10736068-eb76-4e07-adfb-20a8ac8a8f0d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:48.036666 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-10736068-eb76-4e07-adfb-20a8ac8a8f0d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:48.175961 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-10736068-eb76-4e07-adfb-20a8ac8a8f0d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:48.184748 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-10736068-eb76-4e07-adfb-20a8ac8a8f0d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.161852 Aug 31 11:11:48.185333 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 477/883] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:48 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:48.449258 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a206ac19-a289-4d38-87c6-7d9be824f663 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:48.449869 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a206ac19-a289-4d38-87c6-7d9be824f663 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:48.457645 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a206ac19-a289-4d38-87c6-7d9be824f663 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:48.458280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a206ac19-a289-4d38-87c6-7d9be824f663 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:48.458888 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a206ac19-a289-4d38-87c6-7d9be824f663 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:48.459747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a206ac19-a289-4d38-87c6-7d9be824f663 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:48.460265 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a206ac19-a289-4d38-87c6-7d9be824f663 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:48.460692 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a206ac19-a289-4d38-87c6-7d9be824f663 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:48.490869 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-b421009f-5293-47b6-99d0-3167f9d9a570 req-0c596666-65cb-45dd-b5ce-935446bff0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8572f06c-5fe1-4496-b9e7-92ae0d9b6b84", "name": "network-vif-plugged", "status": "completed", "tag": "61614d6e-8cbb-415d-9054-acb80c091e6f"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:48.501666 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b421009f-5293-47b6-99d0-3167f9d9a570 req-0c596666-65cb-45dd-b5ce-935446bff0cf service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:48.502143 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b421009f-5293-47b6-99d0-3167f9d9a570 req-0c596666-65cb-45dd-b5ce-935446bff0cf service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:48.502573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b421009f-5293-47b6-99d0-3167f9d9a570 req-0c596666-65cb-45dd-b5ce-935446bff0cf service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:48.517133 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-b421009f-5293-47b6-99d0-3167f9d9a570 req-0c596666-65cb-45dd-b5ce-935446bff0cf service nova] Creating event network-vif-plugged:61614d6e-8cbb-415d-9054-acb80c091e6f for instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 on hv-cinder-85535 Aug 31 11:11:48.522199 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-b421009f-5293-47b6-99d0-3167f9d9a570 req-0c596666-65cb-45dd-b5ce-935446bff0cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035179 Aug 31 11:11:48.522963 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 478/884] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:11:48.536704 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2886fd0f-ac27-43c1-97ab-3bc12b287c77 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:48.537803 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2886fd0f-ac27-43c1-97ab-3bc12b287c77 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:48.553663 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2886fd0f-ac27-43c1-97ab-3bc12b287c77 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:48.554398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2886fd0f-ac27-43c1-97ab-3bc12b287c77 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:48.555749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2886fd0f-ac27-43c1-97ab-3bc12b287c77 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:48.556711 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2886fd0f-ac27-43c1-97ab-3bc12b287c77 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:48.557549 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2886fd0f-ac27-43c1-97ab-3bc12b287c77 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:48.558175 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2886fd0f-ac27-43c1-97ab-3bc12b287c77 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:48.620222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a206ac19-a289-4d38-87c6-7d9be824f663 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:48.629051 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a206ac19-a289-4d38-87c6-7d9be824f663 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:48.630508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a206ac19-a289-4d38-87c6-7d9be824f663 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:48.631725 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a206ac19-a289-4d38-87c6-7d9be824f663 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.186576 Aug 31 11:11:48.632697 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 407/885] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:48 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:11:48.711078 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2886fd0f-ac27-43c1-97ab-3bc12b287c77 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:48.718949 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2886fd0f-ac27-43c1-97ab-3bc12b287c77 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1452 microversion: 2.1 time: 0.187924 Aug 31 11:11:48.720080 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 479/886] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:48 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1452 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:11:48.740665 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-189834b9-3e18-4d42-9fd8-63512c6ef9da tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:48.741579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-189834b9-3e18-4d42-9fd8-63512c6ef9da tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:48.747906 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-189834b9-3e18-4d42-9fd8-63512c6ef9da tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:48.748645 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-189834b9-3e18-4d42-9fd8-63512c6ef9da tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:48.749060 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-189834b9-3e18-4d42-9fd8-63512c6ef9da tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:48.750368 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-189834b9-3e18-4d42-9fd8-63512c6ef9da tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:48.750828 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-189834b9-3e18-4d42-9fd8-63512c6ef9da tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:48.751254 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-189834b9-3e18-4d42-9fd8-63512c6ef9da tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:48.912398 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-189834b9-3e18-4d42-9fd8-63512c6ef9da tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:48.920676 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-189834b9-3e18-4d42-9fd8-63512c6ef9da tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1452 microversion: 2.1 time: 0.183790 Aug 31 11:11:48.921384 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 408/887] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:48 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:49.206350 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1a1db16f-26a3-4266-b509-880bc7ba2d5c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:49.207733 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1a1db16f-26a3-4266-b509-880bc7ba2d5c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:49.217446 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1a1db16f-26a3-4266-b509-880bc7ba2d5c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:49.219666 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1a1db16f-26a3-4266-b509-880bc7ba2d5c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:49.220334 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1a1db16f-26a3-4266-b509-880bc7ba2d5c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:49.222080 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1a1db16f-26a3-4266-b509-880bc7ba2d5c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:49.222875 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1a1db16f-26a3-4266-b509-880bc7ba2d5c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:49.224757 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1a1db16f-26a3-4266-b509-880bc7ba2d5c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:49.382065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-1a1db16f-26a3-4266-b509-880bc7ba2d5c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:49.391852 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1a1db16f-26a3-4266-b509-880bc7ba2d5c tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.190194 Aug 31 11:11:49.392882 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 480/888] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:49 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:49.654897 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1bc12864-dd12-4066-94b8-0e5ccda95850 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:49.655781 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-1bc12864-dd12-4066-94b8-0e5ccda95850 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:49.662594 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1bc12864-dd12-4066-94b8-0e5ccda95850 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:49.663117 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1bc12864-dd12-4066-94b8-0e5ccda95850 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:49.663505 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1bc12864-dd12-4066-94b8-0e5ccda95850 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:49.664259 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1bc12864-dd12-4066-94b8-0e5ccda95850 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:49.664713 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1bc12864-dd12-4066-94b8-0e5ccda95850 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:49.665134 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1bc12864-dd12-4066-94b8-0e5ccda95850 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:49.917356 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-1bc12864-dd12-4066-94b8-0e5ccda95850 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:49.926030 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-1bc12864-dd12-4066-94b8-0e5ccda95850 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:49.927857 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-1bc12864-dd12-4066-94b8-0e5ccda95850 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:49.929040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-1bc12864-dd12-4066-94b8-0e5ccda95850 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1730 microversion: 2.20 time: 0.278118 Aug 31 11:11:49.929595 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 409/889] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:49 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1730 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:50.413273 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-11a1a83c-8dc3-40c1-b293-aa1793f97f43 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:50.413848 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-11a1a83c-8dc3-40c1-b293-aa1793f97f43 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:50.423360 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-11a1a83c-8dc3-40c1-b293-aa1793f97f43 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:50.423852 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-11a1a83c-8dc3-40c1-b293-aa1793f97f43 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:50.424312 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-11a1a83c-8dc3-40c1-b293-aa1793f97f43 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:50.425015 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-11a1a83c-8dc3-40c1-b293-aa1793f97f43 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:50.425468 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-11a1a83c-8dc3-40c1-b293-aa1793f97f43 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:50.425880 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-11a1a83c-8dc3-40c1-b293-aa1793f97f43 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:50.539079 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-b10e11b3-60a0-438c-a9ee-cc0aad9e4607 req-2e960ce1-7767-47af-b5ee-22c0857c55c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ae93cb-bdd8-4d6a-85f5-52918c72f87b", "name": "network-vif-plugged", "status": "completed", "tag": "2f72082c-c379-4dfa-8614-d7a320906f23"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:50.558558 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-b10e11b3-60a0-438c-a9ee-cc0aad9e4607 req-2e960ce1-7767-47af-b5ee-22c0857c55c5 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:50.559339 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-b10e11b3-60a0-438c-a9ee-cc0aad9e4607 req-2e960ce1-7767-47af-b5ee-22c0857c55c5 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:50.559833 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-b10e11b3-60a0-438c-a9ee-cc0aad9e4607 req-2e960ce1-7767-47af-b5ee-22c0857c55c5 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:50.583570 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-b10e11b3-60a0-438c-a9ee-cc0aad9e4607 req-2e960ce1-7767-47af-b5ee-22c0857c55c5 service nova] Creating event network-vif-plugged:2f72082c-c379-4dfa-8614-d7a320906f23 for instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b on hv-cinder-85535 Aug 31 11:11:50.588882 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-b10e11b3-60a0-438c-a9ee-cc0aad9e4607 req-2e960ce1-7767-47af-b5ee-22c0857c55c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054332 Aug 31 11:11:50.590006 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 410/890] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:11:50.642354 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-11a1a83c-8dc3-40c1-b293-aa1793f97f43 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:50.652727 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-11a1a83c-8dc3-40c1-b293-aa1793f97f43 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.243419 Aug 31 11:11:50.653340 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 481/891] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:50 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:50.954803 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d6468d9d-94f5-464f-88af-06b338d6db18 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:50.955741 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d6468d9d-94f5-464f-88af-06b338d6db18 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:50.963374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d6468d9d-94f5-464f-88af-06b338d6db18 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:50.964238 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d6468d9d-94f5-464f-88af-06b338d6db18 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:50.964876 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d6468d9d-94f5-464f-88af-06b338d6db18 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:50.965768 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d6468d9d-94f5-464f-88af-06b338d6db18 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:50.966287 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d6468d9d-94f5-464f-88af-06b338d6db18 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:50.966801 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d6468d9d-94f5-464f-88af-06b338d6db18 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:51.197202 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d6468d9d-94f5-464f-88af-06b338d6db18 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:51.205702 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d6468d9d-94f5-464f-88af-06b338d6db18 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:51.207143 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d6468d9d-94f5-464f-88af-06b338d6db18 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:51.208326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d6468d9d-94f5-464f-88af-06b338d6db18 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1717 microversion: 2.20 time: 0.258832 Aug 31 11:11:51.208875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 411/892] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:11:50 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1717 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:11:51.322311 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-b5cb3011-79a2-4b6b-bec8-78e468b5a925 req-e7f2e43d-7f0f-42d6-9923-e43a6e29af06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a86bd6-faab-4980-ac6b-19ecb1d2bf5b", "tag": "529be65a-b8c1-4b8d-b9bf-ef0a72d238ae"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:51.332197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b5cb3011-79a2-4b6b-bec8-78e468b5a925 req-e7f2e43d-7f0f-42d6-9923-e43a6e29af06 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:51.332770 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b5cb3011-79a2-4b6b-bec8-78e468b5a925 req-e7f2e43d-7f0f-42d6-9923-e43a6e29af06 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:51.333491 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-b5cb3011-79a2-4b6b-bec8-78e468b5a925 req-e7f2e43d-7f0f-42d6-9923-e43a6e29af06 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:51.346914 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-b5cb3011-79a2-4b6b-bec8-78e468b5a925 req-e7f2e43d-7f0f-42d6-9923-e43a6e29af06 service nova] Creating event network-changed:529be65a-b8c1-4b8d-b9bf-ef0a72d238ae for instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b on hv-cinder-85535 Aug 31 11:11:51.353251 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-b5cb3011-79a2-4b6b-bec8-78e468b5a925 req-e7f2e43d-7f0f-42d6-9923-e43a6e29af06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034608 Aug 31 11:11:51.353866 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 482/893] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:11:51.674760 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a27e7692-d758-4ba5-b508-3d3e5096608a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:51.675404 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a27e7692-d758-4ba5-b508-3d3e5096608a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:51.681295 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a27e7692-d758-4ba5-b508-3d3e5096608a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:51.681780 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a27e7692-d758-4ba5-b508-3d3e5096608a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:51.682226 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a27e7692-d758-4ba5-b508-3d3e5096608a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:51.682911 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a27e7692-d758-4ba5-b508-3d3e5096608a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:51.683363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a27e7692-d758-4ba5-b508-3d3e5096608a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:51.683837 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a27e7692-d758-4ba5-b508-3d3e5096608a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:51.842109 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a27e7692-d758-4ba5-b508-3d3e5096608a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:51.849755 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a27e7692-d758-4ba5-b508-3d3e5096608a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.178865 Aug 31 11:11:51.850328 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 412/894] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:51 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:52.872910 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-927ab3ca-6100-43a6-9f53-1cf4883fa8b7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:52.873584 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-927ab3ca-6100-43a6-9f53-1cf4883fa8b7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:52.883604 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-927ab3ca-6100-43a6-9f53-1cf4883fa8b7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:52.884093 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-927ab3ca-6100-43a6-9f53-1cf4883fa8b7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:52.884426 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-927ab3ca-6100-43a6-9f53-1cf4883fa8b7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:52.885132 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-927ab3ca-6100-43a6-9f53-1cf4883fa8b7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:52.885585 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-927ab3ca-6100-43a6-9f53-1cf4883fa8b7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:52.889346 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-927ab3ca-6100-43a6-9f53-1cf4883fa8b7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:53.039057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-927ab3ca-6100-43a6-9f53-1cf4883fa8b7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:53.046507 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-927ab3ca-6100-43a6-9f53-1cf4883fa8b7 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.179675 Aug 31 11:11:53.047082 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 483/895] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:52 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:54.067588 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d1106374-43fe-4a27-a5a2-245053d3632d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:54.068223 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d1106374-43fe-4a27-a5a2-245053d3632d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:54.074913 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d1106374-43fe-4a27-a5a2-245053d3632d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:54.075528 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d1106374-43fe-4a27-a5a2-245053d3632d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:54.075824 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d1106374-43fe-4a27-a5a2-245053d3632d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:54.076542 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d1106374-43fe-4a27-a5a2-245053d3632d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:54.077619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d1106374-43fe-4a27-a5a2-245053d3632d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:54.078044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d1106374-43fe-4a27-a5a2-245053d3632d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:54.266270 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-dc630a1c-44d0-4ca4-8a6b-04b68247182d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:54.266868 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-dc630a1c-44d0-4ca4-8a6b-04b68247182d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:54.274116 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc630a1c-44d0-4ca4-8a6b-04b68247182d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:54.274777 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc630a1c-44d0-4ca4-8a6b-04b68247182d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:54.275021 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc630a1c-44d0-4ca4-8a6b-04b68247182d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:54.275751 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc630a1c-44d0-4ca4-8a6b-04b68247182d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:54.276246 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc630a1c-44d0-4ca4-8a6b-04b68247182d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:54.276746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc630a1c-44d0-4ca4-8a6b-04b68247182d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:54.307759 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d1106374-43fe-4a27-a5a2-245053d3632d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:54.316476 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d1106374-43fe-4a27-a5a2-245053d3632d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1362 microversion: 2.1 time: 0.252693 Aug 31 11:11:54.317262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 413/896] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:54 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:54.368061 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-dc630a1c-44d0-4ca4-8a6b-04b68247182d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lazy-loading 'services' on Instance uuid f28b6c6d-05e1-48fa-acee-b169de5dc6cb {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:11:54.441771 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-dc630a1c-44d0-4ca4-8a6b-04b68247182d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/os-volume_attachments/7a5427bc-a258-4219-8d4d-2958b4616428" status: 202 len: 0 microversion: 2.1 time: 0.180449 Aug 31 11:11:54.442363 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 484/897] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 11:11:54 2022] DELETE /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/os-volume_attachments/7a5427bc-a258-4219-8d4d-2958b4616428 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:11:54.450797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b6c072e4-d821-47fe-97c6-969e454da148 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:54.453101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b6c072e4-d821-47fe-97c6-969e454da148 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:54.458990 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b6c072e4-d821-47fe-97c6-969e454da148 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:54.459475 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b6c072e4-d821-47fe-97c6-969e454da148 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:54.459915 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b6c072e4-d821-47fe-97c6-969e454da148 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:54.460643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b6c072e4-d821-47fe-97c6-969e454da148 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:54.461126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b6c072e4-d821-47fe-97c6-969e454da148 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:54.461553 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b6c072e4-d821-47fe-97c6-969e454da148 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:54.491363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b6c072e4-d821-47fe-97c6-969e454da148 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Aug 31 11:11:54.491948 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 414/898] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:11:54 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:11:55.339065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7f4d7d0c-6990-4858-adaa-7deabe31c808 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:55.339763 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7f4d7d0c-6990-4858-adaa-7deabe31c808 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:55.346040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7f4d7d0c-6990-4858-adaa-7deabe31c808 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:55.346540 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7f4d7d0c-6990-4858-adaa-7deabe31c808 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:55.346959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7f4d7d0c-6990-4858-adaa-7deabe31c808 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:55.347842 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7f4d7d0c-6990-4858-adaa-7deabe31c808 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:55.348327 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7f4d7d0c-6990-4858-adaa-7deabe31c808 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:55.348750 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7f4d7d0c-6990-4858-adaa-7deabe31c808 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:55.504380 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-7f4d7d0c-6990-4858-adaa-7deabe31c808 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:55.505161 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4a408a0b-d345-4cf0-8e74-20f5be4175ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:55.507393 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-4a408a0b-d345-4cf0-8e74-20f5be4175ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:55.512935 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7f4d7d0c-6990-4858-adaa-7deabe31c808 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1547 microversion: 2.1 time: 0.178539 Aug 31 11:11:55.513682 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 485/899] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:55 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1547 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:55.517373 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4a408a0b-d345-4cf0-8e74-20f5be4175ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:55.518085 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4a408a0b-d345-4cf0-8e74-20f5be4175ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:55.518526 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4a408a0b-d345-4cf0-8e74-20f5be4175ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:55.519299 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4a408a0b-d345-4cf0-8e74-20f5be4175ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:55.520128 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4a408a0b-d345-4cf0-8e74-20f5be4175ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:55.520705 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4a408a0b-d345-4cf0-8e74-20f5be4175ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:55.534089 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-28197a21-ae62-43dc-a273-774eb15f5cf1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:55.534585 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-28197a21-ae62-43dc-a273-774eb15f5cf1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:55.540603 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-28197a21-ae62-43dc-a273-774eb15f5cf1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:55.541100 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-28197a21-ae62-43dc-a273-774eb15f5cf1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:55.541533 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-28197a21-ae62-43dc-a273-774eb15f5cf1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:55.542227 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-28197a21-ae62-43dc-a273-774eb15f5cf1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:55.542684 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-28197a21-ae62-43dc-a273-774eb15f5cf1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:55.543664 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-28197a21-ae62-43dc-a273-774eb15f5cf1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:55.558218 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4a408a0b-d345-4cf0-8e74-20f5be4175ec tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057111 Aug 31 11:11:55.558807 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 415/900] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:11:55 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:11:55.625612 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-28197a21-ae62-43dc-a273-774eb15f5cf1 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096129 Aug 31 11:11:55.626209 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 486/901] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 11:11:55 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:11:56.570454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-dab678b4-9497-41a5-8d42-6f6fd0e6ad8b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:56.573160 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-dab678b4-9497-41a5-8d42-6f6fd0e6ad8b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:56.581873 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dab678b4-9497-41a5-8d42-6f6fd0e6ad8b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:56.582717 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dab678b4-9497-41a5-8d42-6f6fd0e6ad8b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:56.583320 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dab678b4-9497-41a5-8d42-6f6fd0e6ad8b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:56.584039 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dab678b4-9497-41a5-8d42-6f6fd0e6ad8b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:56.584501 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dab678b4-9497-41a5-8d42-6f6fd0e6ad8b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:56.584922 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dab678b4-9497-41a5-8d42-6f6fd0e6ad8b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:56.617453 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-dab678b4-9497-41a5-8d42-6f6fd0e6ad8b tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050856 Aug 31 11:11:56.618296 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 416/902] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:11:56 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:11:56.690978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-dbcefe67-0a21-44aa-bd99-15b9911da862 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:56.691544 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-dbcefe67-0a21-44aa-bd99-15b9911da862 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:56.700891 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dbcefe67-0a21-44aa-bd99-15b9911da862 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:56.701547 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dbcefe67-0a21-44aa-bd99-15b9911da862 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:56.702582 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dbcefe67-0a21-44aa-bd99-15b9911da862 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:56.704164 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dbcefe67-0a21-44aa-bd99-15b9911da862 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:56.704813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dbcefe67-0a21-44aa-bd99-15b9911da862 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:56.705338 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-dbcefe67-0a21-44aa-bd99-15b9911da862 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:56.749334 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-dbcefe67-0a21-44aa-bd99-15b9911da862 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Going to try to terminate instance {{(pid=120655) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:11:56.751528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-dd10860e-7603-43f1-8633-17f8b220e8c0 req-5312345e-8aa9-4054-ba41-63a99335c6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ae93cb-bdd8-4d6a-85f5-52918c72f87b", "tag": "2f72082c-c379-4dfa-8614-d7a320906f23"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:56.764926 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:11:56.770466 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-dd10860e-7603-43f1-8633-17f8b220e8c0 req-5312345e-8aa9-4054-ba41-63a99335c6a0 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:56.771094 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-dd10860e-7603-43f1-8633-17f8b220e8c0 req-5312345e-8aa9-4054-ba41-63a99335c6a0 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:56.775846 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-dd10860e-7603-43f1-8633-17f8b220e8c0 req-5312345e-8aa9-4054-ba41-63a99335c6a0 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:56.798252 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-dd10860e-7603-43f1-8633-17f8b220e8c0 req-5312345e-8aa9-4054-ba41-63a99335c6a0 service nova] Creating event network-changed:2f72082c-c379-4dfa-8614-d7a320906f23 for instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b on hv-cinder-85535 Aug 31 11:11:56.804274 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-dd10860e-7603-43f1-8633-17f8b220e8c0 req-5312345e-8aa9-4054-ba41-63a99335c6a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219926 Aug 31 11:11:56.805516 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 487/903] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:11:56.844037 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-dbcefe67-0a21-44aa-bd99-15b9911da862 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 204 len: 0 microversion: 2.1 time: 0.157187 Aug 31 11:11:56.847810 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 417/904] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:11:56 2022] DELETE /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:11:56.863436 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-49dd253a-41bc-45e1-bb24-1d5cdab2c47a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:56.864309 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-49dd253a-41bc-45e1-bb24-1d5cdab2c47a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:56.871246 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-49dd253a-41bc-45e1-bb24-1d5cdab2c47a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:56.871748 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-49dd253a-41bc-45e1-bb24-1d5cdab2c47a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:56.872230 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-49dd253a-41bc-45e1-bb24-1d5cdab2c47a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:56.872929 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-49dd253a-41bc-45e1-bb24-1d5cdab2c47a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:56.873375 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-49dd253a-41bc-45e1-bb24-1d5cdab2c47a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:56.874362 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-49dd253a-41bc-45e1-bb24-1d5cdab2c47a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:57.013173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-49dd253a-41bc-45e1-bb24-1d5cdab2c47a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:57.021085 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-49dd253a-41bc-45e1-bb24-1d5cdab2c47a tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1679 microversion: 2.1 time: 0.171385 Aug 31 11:11:57.021822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 488/905] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:56 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:58.044230 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3e9d9af7-6b32-421e-ac62-e0c11ee45de2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:58.044962 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3e9d9af7-6b32-421e-ac62-e0c11ee45de2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:58.051990 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e9d9af7-6b32-421e-ac62-e0c11ee45de2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:58.052497 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e9d9af7-6b32-421e-ac62-e0c11ee45de2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:58.052931 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e9d9af7-6b32-421e-ac62-e0c11ee45de2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:58.053621 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e9d9af7-6b32-421e-ac62-e0c11ee45de2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:58.054071 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e9d9af7-6b32-421e-ac62-e0c11ee45de2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:58.054495 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3e9d9af7-6b32-421e-ac62-e0c11ee45de2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:58.206136 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3e9d9af7-6b32-421e-ac62-e0c11ee45de2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:58.215258 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3e9d9af7-6b32-421e-ac62-e0c11ee45de2 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1679 microversion: 2.1 time: 0.175125 Aug 31 11:11:58.215880 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 418/906] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:58 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:59.238210 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-dc682221-40f9-4c8a-934f-6944329f1944 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:11:59.238818 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-dc682221-40f9-4c8a-934f-6944329f1944 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:11:59.245424 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc682221-40f9-4c8a-934f-6944329f1944 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:59.245903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc682221-40f9-4c8a-934f-6944329f1944 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:59.246339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc682221-40f9-4c8a-934f-6944329f1944 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:59.247220 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc682221-40f9-4c8a-934f-6944329f1944 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:59.247524 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc682221-40f9-4c8a-934f-6944329f1944 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:59.247900 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-dc682221-40f9-4c8a-934f-6944329f1944 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:59.331906 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-dc682221-40f9-4c8a-934f-6944329f1944 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e5dae087184c56b1cb72fb7705d4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173d9af664764ba5bd694dab38d8bb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:11:59.339671 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-dc682221-40f9-4c8a-934f-6944329f1944 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 200 len: 1611 microversion: 2.1 time: 0.105554 Aug 31 11:11:59.353514 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 489/907] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:11:59 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 1611 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:11:59.607042 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-518ddea7-b35e-4cca-a95a-fd3c1915b075 req-29d1b04b-15d9-4be0-87c1-44741b617889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28b6c6d-05e1-48fa-acee-b169de5dc6cb", "name": "network-vif-deleted", "tag": "7bfcfade-8041-4e70-b6fd-dbe86a28ffdb"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:11:59.619013 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-518ddea7-b35e-4cca-a95a-fd3c1915b075 req-29d1b04b-15d9-4be0-87c1-44741b617889 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:11:59.619498 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-518ddea7-b35e-4cca-a95a-fd3c1915b075 req-29d1b04b-15d9-4be0-87c1-44741b617889 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:11:59.619925 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-518ddea7-b35e-4cca-a95a-fd3c1915b075 req-29d1b04b-15d9-4be0-87c1-44741b617889 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:11:59.644031 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-518ddea7-b35e-4cca-a95a-fd3c1915b075 req-29d1b04b-15d9-4be0-87c1-44741b617889 service nova] Creating event network-vif-deleted:7bfcfade-8041-4e70-b6fd-dbe86a28ffdb for instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb on hv-cinder-85535 Aug 31 11:11:59.658062 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-518ddea7-b35e-4cca-a95a-fd3c1915b075 req-29d1b04b-15d9-4be0-87c1-44741b617889 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054225 Aug 31 11:11:59.659083 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 419/908] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:12:00.361908 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5ed21b44-94c9-44a8-9e77-442204b5c5e7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:00.363750 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-5ed21b44-94c9-44a8-9e77-442204b5c5e7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:00.370435 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5ed21b44-94c9-44a8-9e77-442204b5c5e7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:00.371283 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5ed21b44-94c9-44a8-9e77-442204b5c5e7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:00.372370 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5ed21b44-94c9-44a8-9e77-442204b5c5e7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:00.373375 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5ed21b44-94c9-44a8-9e77-442204b5c5e7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:00.374173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5ed21b44-94c9-44a8-9e77-442204b5c5e7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:00.374756 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-5ed21b44-94c9-44a8-9e77-442204b5c5e7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:00.391799 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-5ed21b44-94c9-44a8-9e77-442204b5c5e7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5ed21b44-94c9-44a8-9e77-442204b5c5e7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb HTTP/1.1 Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:12:00.394035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:12:00.395456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:12:00.395456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:00.395456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:00.395456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:00.395456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:00.395456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:12:00.395456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:12:00.395456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:12:00.395456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:00.395456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:12:00.395456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:00.395456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': 'f28b6c6d-05e1-48fa-acee-b169de5dc6cb'} Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:00.396297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:00.397625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:00.400520 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-5ed21b44-94c9-44a8-9e77-442204b5c5e7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 404 to user: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:00.402911 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-5ed21b44-94c9-44a8-9e77-442204b5c5e7 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 404 len: 111 microversion: 2.1 time: 0.045417 Aug 31 11:12:00.403739 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 490/909] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:12:00 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:12:00.414495 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f6d80d5a-05b7-43ce-94d8-2cfad7b55f45 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '.version_select at 0x7f732d2c2430>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:00.435760 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-f6d80d5a-05b7-43ce-94d8-2cfad7b55f45 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128469173" status: 202 len: 0 microversion: 2.1 time: 0.025570 Aug 31 11:12:00.436381 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 420/910] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 31 11:12:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128469173 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:12:02.231732 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-64ad3ccf-f279-4361-8337-1fe58ddfab50 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:02.232366 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-64ad3ccf-f279-4361-8337-1fe58ddfab50 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:02.239494 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-64ad3ccf-f279-4361-8337-1fe58ddfab50 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:02.239986 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-64ad3ccf-f279-4361-8337-1fe58ddfab50 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:02.240450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-64ad3ccf-f279-4361-8337-1fe58ddfab50 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:02.241161 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-64ad3ccf-f279-4361-8337-1fe58ddfab50 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:02.241617 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-64ad3ccf-f279-4361-8337-1fe58ddfab50 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:02.242081 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-64ad3ccf-f279-4361-8337-1fe58ddfab50 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:02.258337 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-64ad3ccf-f279-4361-8337-1fe58ddfab50 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-64ad3ccf-f279-4361-8337-1fe58ddfab50 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: DELETE /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb HTTP/1.1 Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:12:02.259890 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:12:02.261573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:12:02.261573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:02.261573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:02.261573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:02.261573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:02.261573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:12:02.261573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:12:02.261573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:12:02.261573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:02.261573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:12:02.261573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:02.261573 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': 'f28b6c6d-05e1-48fa-acee-b169de5dc6cb'} Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:02.262484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:02.263987 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:02.265516 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-64ad3ccf-f279-4361-8337-1fe58ddfab50 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 404 to user: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:02.265516 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-64ad3ccf-f279-4361-8337-1fe58ddfab50 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 404 len: 111 microversion: 2.1 time: 0.033490 Aug 31 11:12:02.265516 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 491/911] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:12:02 2022] DELETE /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:12:02.270588 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6bdd38cb-c880-4b11-a530-a5e905683ab6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:02.271386 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6bdd38cb-c880-4b11-a530-a5e905683ab6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: f28b6c6d-05e1-48fa-acee-b169de5dc6cb] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:02.273299 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:02.282848 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bdd38cb-c880-4b11-a530-a5e905683ab6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:02.283436 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bdd38cb-c880-4b11-a530-a5e905683ab6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:02.284021 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bdd38cb-c880-4b11-a530-a5e905683ab6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:02.284749 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bdd38cb-c880-4b11-a530-a5e905683ab6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:02.285204 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bdd38cb-c880-4b11-a530-a5e905683ab6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:02.285629 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bdd38cb-c880-4b11-a530-a5e905683ab6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:02.301966 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-6bdd38cb-c880-4b11-a530-a5e905683ab6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6bdd38cb-c880-4b11-a530-a5e905683ab6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb HTTP/1.1 Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:12:02.303619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:12:02.305349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:12:02.305349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:02.305349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:02.305349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:02.305349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:02.305349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:12:02.305349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:12:02.305349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:12:02.305349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:02.305349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:12:02.305349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:02.305349 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': 'f28b6c6d-05e1-48fa-acee-b169de5dc6cb'} Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:02.306402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. Aug 31 11:12:02.307875 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:02.309309 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6bdd38cb-c880-4b11-a530-a5e905683ab6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 404 to user: Instance f28b6c6d-05e1-48fa-acee-b169de5dc6cb could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:02.309309 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6bdd38cb-c880-4b11-a530-a5e905683ab6 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb" status: 404 len: 111 microversion: 2.1 time: 0.038956 Aug 31 11:12:02.309309 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 421/912] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:12:02 2022] GET /compute/v2.1/servers/f28b6c6d-05e1-48fa-acee-b169de5dc6cb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:12:03.452745 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d2c0621c-3ce8-4990-8e5e-0d0accb61c90 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:03.453389 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d2c0621c-3ce8-4990-8e5e-0d0accb61c90 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:03.460377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d2c0621c-3ce8-4990-8e5e-0d0accb61c90 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:03.460778 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d2c0621c-3ce8-4990-8e5e-0d0accb61c90 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:03.461210 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d2c0621c-3ce8-4990-8e5e-0d0accb61c90 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:03.461915 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d2c0621c-3ce8-4990-8e5e-0d0accb61c90 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:03.462362 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d2c0621c-3ce8-4990-8e5e-0d0accb61c90 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:03.463120 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d2c0621c-3ce8-4990-8e5e-0d0accb61c90 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:03.477635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-d2c0621c-3ce8-4990-8e5e-0d0accb61c90 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d2c0621c-3ce8-4990-8e5e-0d0accb61c90 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: DELETE /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 HTTP/1.1 Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:12:03.479188 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:12:03.480947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:12:03.480947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:03.480947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:03.480947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:03.480947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:03.480947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:12:03.480947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:12:03.480947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:12:03.480947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:03.480947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:12:03.480947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:12:03.480947 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '2f70e795-e50c-414e-b302-2b818ce84337'} Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:03.482242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:12:03.484819 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.487101 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d2c0621c-3ce8-4990-8e5e-0d0accb61c90 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 404 to user: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:03.487101 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d2c0621c-3ce8-4990-8e5e-0d0accb61c90 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 404 len: 111 microversion: 2.1 time: 0.033223 Aug 31 11:12:03.487101 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 492/913] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:12:03 2022] DELETE /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:12:03.493115 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b9b705cf-3a61-4434-9979-acb475dabb71 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:03.493724 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b9b705cf-3a61-4434-9979-acb475dabb71 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 2f70e795-e50c-414e-b302-2b818ce84337] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:03.500801 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b9b705cf-3a61-4434-9979-acb475dabb71 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:03.501273 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b9b705cf-3a61-4434-9979-acb475dabb71 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:03.501695 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b9b705cf-3a61-4434-9979-acb475dabb71 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:03.502377 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b9b705cf-3a61-4434-9979-acb475dabb71 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:03.502820 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b9b705cf-3a61-4434-9979-acb475dabb71 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:03.503233 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b9b705cf-3a61-4434-9979-acb475dabb71 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:03.516335 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-b9b705cf-3a61-4434-9979-acb475dabb71 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b9b705cf-3a61-4434-9979-acb475dabb71 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 HTTP/1.1 Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:12:03.517845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:12:03.519561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:12:03.519561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:03.519561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:03.519561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:03.519561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:03.519561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:12:03.519561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:12:03.519561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:12:03.519561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:03.519561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:12:03.519561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:12:03.519561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '2f70e795-e50c-414e-b302-2b818ce84337'} Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:03.520597 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. Aug 31 11:12:03.521903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.523096 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b9b705cf-3a61-4434-9979-acb475dabb71 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 404 to user: Instance 2f70e795-e50c-414e-b302-2b818ce84337 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:03.523096 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b9b705cf-3a61-4434-9979-acb475dabb71 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337" status: 404 len: 111 microversion: 2.1 time: 0.030340 Aug 31 11:12:03.523096 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 422/914] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:12:03 2022] GET /compute/v2.1/servers/2f70e795-e50c-414e-b302-2b818ce84337 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:12:03.527822 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7244d2bf-f5c6-4bd9-8aad-90c3d2c0cfda tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:03.528367 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-7244d2bf-f5c6-4bd9-8aad-90c3d2c0cfda tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:03.534654 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7244d2bf-f5c6-4bd9-8aad-90c3d2c0cfda tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:03.535156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7244d2bf-f5c6-4bd9-8aad-90c3d2c0cfda tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:03.535585 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7244d2bf-f5c6-4bd9-8aad-90c3d2c0cfda tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:03.536301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7244d2bf-f5c6-4bd9-8aad-90c3d2c0cfda tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:03.536798 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7244d2bf-f5c6-4bd9-8aad-90c3d2c0cfda tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:03.537215 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-7244d2bf-f5c6-4bd9-8aad-90c3d2c0cfda tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:03.552082 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-7244d2bf-f5c6-4bd9-8aad-90c3d2c0cfda tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7244d2bf-f5c6-4bd9-8aad-90c3d2c0cfda tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: DELETE /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 HTTP/1.1 Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:12:03.554083 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:12:03.556884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:12:03.556884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:03.556884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:03.556884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:03.556884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:03.556884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:12:03.556884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:12:03.556884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:12:03.556884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:03.556884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:12:03.556884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:12:03.556884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '962f8405-fd3a-4f34-92de-a437bdcb7845'} Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:03.558619 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:12:03.561197 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.563214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-7244d2bf-f5c6-4bd9-8aad-90c3d2c0cfda tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 404 to user: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:03.563214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-7244d2bf-f5c6-4bd9-8aad-90c3d2c0cfda tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 404 len: 111 microversion: 2.1 time: 0.031931 Aug 31 11:12:03.563214 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 493/915] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:12:03 2022] DELETE /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:12:03.567702 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d5a5c765-dc19-4861-87e1-b1aefba2bb56 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:03.568347 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d5a5c765-dc19-4861-87e1-b1aefba2bb56 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: 962f8405-fd3a-4f34-92de-a437bdcb7845] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:03.574338 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5a5c765-dc19-4861-87e1-b1aefba2bb56 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:03.574813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5a5c765-dc19-4861-87e1-b1aefba2bb56 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:03.575244 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5a5c765-dc19-4861-87e1-b1aefba2bb56 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:03.575930 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5a5c765-dc19-4861-87e1-b1aefba2bb56 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:03.576405 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5a5c765-dc19-4861-87e1-b1aefba2bb56 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:03.576827 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5a5c765-dc19-4861-87e1-b1aefba2bb56 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:03.589873 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-d5a5c765-dc19-4861-87e1-b1aefba2bb56 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d5a5c765-dc19-4861-87e1-b1aefba2bb56 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 HTTP/1.1 Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:12:03.591367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:12:03.592937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:12:03.592937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:03.592937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:03.592937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:03.592937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:03.592937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:12:03.592937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:12:03.592937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:12:03.592937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:03.592937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:12:03.592937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:12:03.592937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '962f8405-fd3a-4f34-92de-a437bdcb7845'} Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:03.594002 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. Aug 31 11:12:03.595433 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:03.596708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d5a5c765-dc19-4861-87e1-b1aefba2bb56 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 404 to user: Instance 962f8405-fd3a-4f34-92de-a437bdcb7845 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:03.596708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d5a5c765-dc19-4861-87e1-b1aefba2bb56 tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845" status: 404 len: 111 microversion: 2.1 time: 0.031418 Aug 31 11:12:03.596708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 423/916] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:12:03 2022] GET /compute/v2.1/servers/962f8405-fd3a-4f34-92de-a437bdcb7845 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:12:04.738933 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2164f7bb-046d-4d9b-bdde-24ba0cf67e7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:04.739444 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2164f7bb-046d-4d9b-bdde-24ba0cf67e7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:04.741870 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=92 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:04.747026 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2164f7bb-046d-4d9b-bdde-24ba0cf67e7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:04.747510 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2164f7bb-046d-4d9b-bdde-24ba0cf67e7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:04.747939 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2164f7bb-046d-4d9b-bdde-24ba0cf67e7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:04.748681 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2164f7bb-046d-4d9b-bdde-24ba0cf67e7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:04.749130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2164f7bb-046d-4d9b-bdde-24ba0cf67e7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:04.749551 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2164f7bb-046d-4d9b-bdde-24ba0cf67e7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:04.768809 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-2164f7bb-046d-4d9b-bdde-24ba0cf67e7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2164f7bb-046d-4d9b-bdde-24ba0cf67e7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: DELETE /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 HTTP/1.1 Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:12:04.770391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:12:04.772073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:12:04.772073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:04.772073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:04.772073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:04.772073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:04.772073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:12:04.772073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:12:04.772073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:12:04.772073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:04.772073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:12:04.772073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:12:04.772073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': 'a9af9ee9-af17-4f68-bb4a-dcebd9827b12'} Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:04.775887 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:12:04.777345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:04.779450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2164f7bb-046d-4d9b-bdde-24ba0cf67e7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 404 to user: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:04.779450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2164f7bb-046d-4d9b-bdde-24ba0cf67e7f tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 404 len: 111 microversion: 2.1 time: 0.037344 Aug 31 11:12:04.779450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 494/917] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:12:04 2022] DELETE /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:12:04.780337 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e3230c4b-2c72-4512-9a05-c2fd3b76432d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:04.780939 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e3230c4b-2c72-4512-9a05-c2fd3b76432d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] [instance: a9af9ee9-af17-4f68-bb4a-dcebd9827b12] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:04.788685 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3230c4b-2c72-4512-9a05-c2fd3b76432d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:04.789360 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3230c4b-2c72-4512-9a05-c2fd3b76432d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:04.789573 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3230c4b-2c72-4512-9a05-c2fd3b76432d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:04.790258 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3230c4b-2c72-4512-9a05-c2fd3b76432d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:04.790703 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3230c4b-2c72-4512-9a05-c2fd3b76432d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:04.791117 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e3230c4b-2c72-4512-9a05-c2fd3b76432d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:04.805064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-e3230c4b-2c72-4512-9a05-c2fd3b76432d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] HTTP exception thrown: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e3230c4b-2c72-4512-9a05-c2fd3b76432d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Request method failure captured: Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 HTTP/1.1 Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0B0s-t71fqt3rtS0A6OwvlCOn1y6kpE31m_kjs9zA2SDZ5Lk-iTZFIi-uX1-0flPNxxQqCjqwy_Y0aU-U_qRF3v-q6XAyHAZqN-FUA8AfjLo7QTBSoDh9ra4Qo9np0EN_De9ZjaKo5vqoGATBit_yvQ_AWQXdikHAXqD7tGftx8vz0 Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:12:04.806575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:12:04.808222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/173d9af664764ba5bd694dab38d8bb6a"}]}] Aug 31 11:12:04.808222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:04.808222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 173d9af664764ba5bd694dab38d8bb6a Aug 31 11:12:04.808222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-75394734 Aug 31 11:12:04.808222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:04.808222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:12:04.808222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:12:04.808222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: d0e5dae087184c56b1cb72fb7705d4d5 Aug 31 11:12:04.808222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeNegativeTest-75394734-project Aug 31 11:12:04.808222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:12:04.808222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:12:04.808222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': 'a9af9ee9-af17-4f68-bb4a-dcebd9827b12'} Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:04.809076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. Aug 31 11:12:04.810303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:04.811382 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e3230c4b-2c72-4512-9a05-c2fd3b76432d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] Returning 404 to user: Instance a9af9ee9-af17-4f68-bb4a-dcebd9827b12 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:04.811382 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e3230c4b-2c72-4512-9a05-c2fd3b76432d tempest-AttachVolumeNegativeTest-75394734 tempest-AttachVolumeNegativeTest-75394734-project] 10.222.0.20 "GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12" status: 404 len: 111 microversion: 2.1 time: 0.031371 Aug 31 11:12:04.811382 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 424/918] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:12:04 2022] GET /compute/v2.1/servers/a9af9ee9-af17-4f68-bb4a-dcebd9827b12 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:12:09.417522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b7c62300-ac7f-4b39-9f6b-c6cac0bceb8d tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Action: 'create', calling method: .version_select at 0x7f732d354550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1083762079", "metadata": {"Type": "work"}}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b7c62300-ac7f-4b39-9f6b-c6cac0bceb8d tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Request method failure captured: Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 122 Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0IJ2iiQBA-i09ZNiNz-_r-mk1FnyIiHf-TQxIV1gEREC-mmaEPzBs09cCNSq3QyFk6Cny392hUggrZue19p-sQwE44vZlTivCSggxfSP9jTR0BYr15UlR9AGU_bkjJw9dWsOl-YBLJyIYfvtnCSE4Fv3XreVm-AOyNF6Pl-HFoHoqw Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 57a726146b784308aadcbf92eb524483 Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:12:09.433874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57a726146b784308aadcbf92eb524483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57a726146b784308aadcbf92eb524483"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57a726146b784308aadcbf92eb524483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57a726146b784308aadcbf92eb524483"}]}] Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 57a726146b784308aadcbf92eb524483 Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-VolumesNegativeTest-156282747-project Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 87a0a7593e5c49cea2957f574a266a29 Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-VolumesNegativeTest-156282747-project Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1083762079", "metadata": {"Type": "work"}}} Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: Aug 31 11:12:09.435488 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1083762079', 'metadata': {'Type': 'work'}}}} Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise error Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:09.436531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 11:12:09.438244 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 11:12:09.441503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 11:12:09.441503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.441503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b7c62300-ac7f-4b39-9f6b-c6cac0bceb8d tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:09.441503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b7c62300-ac7f-4b39-9f6b-c6cac0bceb8d tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.140317 Aug 31 11:12:09.441503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 495/919] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 31 11:12:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 11:12:09.446694 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-abd30b30-127a-4b55-a137-739f6ad58a22 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Action: 'create', calling method: .version_select at 0x7f732d5bfd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1596051616", "metadata": {"Type": "work"}}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-abd30b30-127a-4b55-a137-739f6ad58a22 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Request method failure captured: Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 120 Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0IJ2iiQBA-i09ZNiNz-_r-mk1FnyIiHf-TQxIV1gEREC-mmaEPzBs09cCNSq3QyFk6Cny392hUggrZue19p-sQwE44vZlTivCSggxfSP9jTR0BYr15UlR9AGU_bkjJw9dWsOl-YBLJyIYfvtnCSE4Fv3XreVm-AOyNF6Pl-HFoHoqw Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 57a726146b784308aadcbf92eb524483 Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:12:09.453537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57a726146b784308aadcbf92eb524483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57a726146b784308aadcbf92eb524483"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57a726146b784308aadcbf92eb524483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57a726146b784308aadcbf92eb524483"}]}] Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 57a726146b784308aadcbf92eb524483 Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-VolumesNegativeTest-156282747-project Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 87a0a7593e5c49cea2957f574a266a29 Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-VolumesNegativeTest-156282747-project Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1596051616", "metadata": {"Type": "work"}}} Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: Aug 31 11:12:09.456350 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1596051616', 'metadata': {'Type': 'work'}}}} Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise error Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi '0' Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:09.457211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 11:12:09.458589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 11:12:09.459764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 11:12:09.459764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.459764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-abd30b30-127a-4b55-a137-739f6ad58a22 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:09.459764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-abd30b30-127a-4b55-a137-739f6ad58a22 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013751 Aug 31 11:12:09.459764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 425/920] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 31 11:12:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:12:09.467932 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1cc63b07-12a8-4f97-9d63-8658ab8e209c tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Action: 'create', calling method: .version_select at 0x7f732d4bc790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1466103671", "metadata": {"Type": "work"}}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1cc63b07-12a8-4f97-9d63-8658ab8e209c tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Request method failure captured: Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 119 Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0IJ2iiQBA-i09ZNiNz-_r-mk1FnyIiHf-TQxIV1gEREC-mmaEPzBs09cCNSq3QyFk6Cny392hUggrZue19p-sQwE44vZlTivCSggxfSP9jTR0BYr15UlR9AGU_bkjJw9dWsOl-YBLJyIYfvtnCSE4Fv3XreVm-AOyNF6Pl-HFoHoqw Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 57a726146b784308aadcbf92eb524483 Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:12:09.473198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57a726146b784308aadcbf92eb524483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57a726146b784308aadcbf92eb524483"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57a726146b784308aadcbf92eb524483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57a726146b784308aadcbf92eb524483"}]}] Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 57a726146b784308aadcbf92eb524483 Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-VolumesNegativeTest-156282747-project Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 87a0a7593e5c49cea2957f574a266a29 Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-VolumesNegativeTest-156282747-project Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1466103671", "metadata": {"Type": "work"}}} Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: Aug 31 11:12:09.474620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1466103671', 'metadata': {'Type': 'work'}}}} Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise error Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi '' Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:09.475812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 11:12:09.477204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 11:12:09.479595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 11:12:09.479595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.479595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1cc63b07-12a8-4f97-9d63-8658ab8e209c tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:09.479595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1cc63b07-12a8-4f97-9d63-8658ab8e209c tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010765 Aug 31 11:12:09.479595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 496/921] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 31 11:12:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 11:12:09.486329 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6dd9b745-cead-4ee7-8b6d-a3676089a6a4 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Calling method '.version_select at 0x7f732d224670>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:09.521143 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-6dd9b745-cead-4ee7-8b6d-a3676089a6a4 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] HTTP exception thrown: Volume tempest-invalid-874206960 could not be found. Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6dd9b745-cead-4ee7-8b6d-a3676089a6a4 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Request method failure captured: Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-874206960 HTTP/1.1 Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0IJ2iiQBA-i09ZNiNz-_r-mk1FnyIiHf-TQxIV1gEREC-mmaEPzBs09cCNSq3QyFk6Cny392hUggrZue19p-sQwE44vZlTivCSggxfSP9jTR0BYr15UlR9AGU_bkjJw9dWsOl-YBLJyIYfvtnCSE4Fv3XreVm-AOyNF6Pl-HFoHoqw Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 57a726146b784308aadcbf92eb524483 Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:12:09.529670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57a726146b784308aadcbf92eb524483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57a726146b784308aadcbf92eb524483"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57a726146b784308aadcbf92eb524483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57a726146b784308aadcbf92eb524483"}]}] Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 57a726146b784308aadcbf92eb524483 Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-VolumesNegativeTest-156282747-project Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 87a0a7593e5c49cea2957f574a266a29 Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-VolumesNegativeTest-156282747-project Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Volume tempest-invalid-874206960 could not be found. Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': 'tempest-invalid-874206960'} Aug 31 11:12:09.531314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-874206960 could not be found. (HTTP 404) (Request-ID: req-d98402a3-fd9d-4193-a570-33d007872e78) Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.532664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:12:09.535165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-874206960 could not be found. Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:09.536533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-874206960 could not be found. Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-874206960 could not be found. Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6dd9b745-cead-4ee7-8b6d-a3676089a6a4 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Returning 404 to user: Volume tempest-invalid-874206960 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6dd9b745-cead-4ee7-8b6d-a3676089a6a4 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-874206960" status: 404 len: 98 microversion: 2.1 time: 0.050715 Aug 31 11:12:09.537924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 426/922] 10.222.0.20 () {58 vars in 1215 bytes} [Wed Aug 31 11:12:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-874206960 => generated 98 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 11:12:09.543731 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4260d9e0-5f13-4ebe-8f49-4610fe384b56 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003813 Aug 31 11:12:09.544266 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 497/923] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Aug 31 11:12:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 11:12:09.553478 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d7a679a9-4981-4743-bbc0-63bc7ac6ea9b tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003797 Aug 31 11:12:09.553995 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 427/924] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Aug 31 11:12:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 11:12:09.562568 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-727bcca5-7766-4051-8961-78e1c7fbcb1e tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Calling method '.version_select at 0x7f732d3b01f0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:09.590542 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-727bcca5-7766-4051-8961-78e1c7fbcb1e tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] HTTP exception thrown: Volume 361ce382-7b3e-4518-a004-65e3df58ac50 could not be found. Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-727bcca5-7766-4051-8961-78e1c7fbcb1e tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Request method failure captured: Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: DELETE /compute/v2.1/os-volumes/361ce382-7b3e-4518-a004-65e3df58ac50 HTTP/1.1 Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0IJ2iiQBA-i09ZNiNz-_r-mk1FnyIiHf-TQxIV1gEREC-mmaEPzBs09cCNSq3QyFk6Cny392hUggrZue19p-sQwE44vZlTivCSggxfSP9jTR0BYr15UlR9AGU_bkjJw9dWsOl-YBLJyIYfvtnCSE4Fv3XreVm-AOyNF6Pl-HFoHoqw Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 57a726146b784308aadcbf92eb524483 Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:12:09.593738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57a726146b784308aadcbf92eb524483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57a726146b784308aadcbf92eb524483"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57a726146b784308aadcbf92eb524483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57a726146b784308aadcbf92eb524483"}]}] Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 57a726146b784308aadcbf92eb524483 Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-VolumesNegativeTest-156282747-project Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 87a0a7593e5c49cea2957f574a266a29 Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-VolumesNegativeTest-156282747-project Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Volume 361ce382-7b3e-4518-a004-65e3df58ac50 could not be found. Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '361ce382-7b3e-4518-a004-65e3df58ac50'} Aug 31 11:12:09.595451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 361ce382-7b3e-4518-a004-65e3df58ac50 could not be found. (HTTP 404) (Request-ID: req-bbbab41f-afdf-4223-9bf7-71624a6362d0) Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.596441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:12:09.597806 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 361ce382-7b3e-4518-a004-65e3df58ac50 could not be found. Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 11:12:09.598959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 361ce382-7b3e-4518-a004-65e3df58ac50 could not be found. Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 361ce382-7b3e-4518-a004-65e3df58ac50 could not be found. Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-727bcca5-7766-4051-8961-78e1c7fbcb1e tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Returning 404 to user: Volume 361ce382-7b3e-4518-a004-65e3df58ac50 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-727bcca5-7766-4051-8961-78e1c7fbcb1e tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/361ce382-7b3e-4518-a004-65e3df58ac50" status: 404 len: 109 microversion: 2.1 time: 0.036435 Aug 31 11:12:09.600319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 498/925] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 11:12:09 2022] DELETE /compute/v2.1/os-volumes/361ce382-7b3e-4518-a004-65e3df58ac50 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:12:09.605040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-33c0e060-71d1-4554-8f28-34befb64fb11 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Calling method '.version_select at 0x7f732d22df70>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:09.633531 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-33c0e060-71d1-4554-8f28-34befb64fb11 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] HTTP exception thrown: Volume e6fda940-cefa-4093-b2d5-6df535a0cf3e could not be found. Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-33c0e060-71d1-4554-8f28-34befb64fb11 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Request method failure captured: Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/os-volumes/e6fda940-cefa-4093-b2d5-6df535a0cf3e HTTP/1.1 Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0IJ2iiQBA-i09ZNiNz-_r-mk1FnyIiHf-TQxIV1gEREC-mmaEPzBs09cCNSq3QyFk6Cny392hUggrZue19p-sQwE44vZlTivCSggxfSP9jTR0BYr15UlR9AGU_bkjJw9dWsOl-YBLJyIYfvtnCSE4Fv3XreVm-AOyNF6Pl-HFoHoqw Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 57a726146b784308aadcbf92eb524483 Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:12:09.635508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57a726146b784308aadcbf92eb524483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57a726146b784308aadcbf92eb524483"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57a726146b784308aadcbf92eb524483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57a726146b784308aadcbf92eb524483"}]}] Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 57a726146b784308aadcbf92eb524483 Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-VolumesNegativeTest-156282747 Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-VolumesNegativeTest-156282747-project Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 87a0a7593e5c49cea2957f574a266a29 Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-VolumesNegativeTest-156282747-project Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Volume e6fda940-cefa-4093-b2d5-6df535a0cf3e could not be found. Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': 'e6fda940-cefa-4093-b2d5-6df535a0cf3e'} Aug 31 11:12:09.637137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6fda940-cefa-4093-b2d5-6df535a0cf3e could not be found. (HTTP 404) (Request-ID: req-e6982d43-2397-432d-b975-bc4bb60c9865) Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.638108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:12:09.639543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6fda940-cefa-4093-b2d5-6df535a0cf3e could not be found. Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 11:12:09.640860 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6fda940-cefa-4093-b2d5-6df535a0cf3e could not be found. Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6fda940-cefa-4093-b2d5-6df535a0cf3e could not be found. Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-33c0e060-71d1-4554-8f28-34befb64fb11 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] Returning 404 to user: Volume e6fda940-cefa-4093-b2d5-6df535a0cf3e could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-33c0e060-71d1-4554-8f28-34befb64fb11 tempest-VolumesNegativeTest-156282747 tempest-VolumesNegativeTest-156282747-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e6fda940-cefa-4093-b2d5-6df535a0cf3e" status: 404 len: 109 microversion: 2.1 time: 0.035715 Aug 31 11:12:09.642643 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 428/926] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:12:09 2022] GET /compute/v2.1/os-volumes/e6fda940-cefa-4093-b2d5-6df535a0cf3e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:12:49.981332 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:49.982677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:49.990090 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-47a7b076-a1ab-4b8e-9d19-d2ba0b941c9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:49.992278 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-47a7b076-a1ab-4b8e-9d19-d2ba0b941c9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:49.999485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-47a7b076-a1ab-4b8e-9d19-d2ba0b941c9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:49.999963 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-47a7b076-a1ab-4b8e-9d19-d2ba0b941c9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:50.000425 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-47a7b076-a1ab-4b8e-9d19-d2ba0b941c9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:50.001117 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-47a7b076-a1ab-4b8e-9d19-d2ba0b941c9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:50.001571 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-47a7b076-a1ab-4b8e-9d19-d2ba0b941c9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:50.001996 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-47a7b076-a1ab-4b8e-9d19-d2ba0b941c9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:50.034978 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-47a7b076-a1ab-4b8e-9d19-d2ba0b941c9e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055181 Aug 31 11:12:50.035557 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 499/927] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 31 11:12:49 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:12:50.099954 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=7 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:50.101281 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:50.106651 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-37289c1f-a2e5-4f8a-aa33-ec463f996430 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:50.107144 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-37289c1f-a2e5-4f8a-aa33-ec463f996430 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:50.114787 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37289c1f-a2e5-4f8a-aa33-ec463f996430 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:50.115334 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37289c1f-a2e5-4f8a-aa33-ec463f996430 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:50.115773 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37289c1f-a2e5-4f8a-aa33-ec463f996430 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:50.116498 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37289c1f-a2e5-4f8a-aa33-ec463f996430 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:50.116951 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37289c1f-a2e5-4f8a-aa33-ec463f996430 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:50.117372 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-37289c1f-a2e5-4f8a-aa33-ec463f996430 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:50.145252 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-37289c1f-a2e5-4f8a-aa33-ec463f996430 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Going to try to terminate instance {{(pid=120655) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:12:50.226490 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-37289c1f-a2e5-4f8a-aa33-ec463f996430 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 204 len: 0 microversion: 2.20 time: 0.128593 Aug 31 11:12:50.230196 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 429/928] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 31 11:12:50 2022] DELETE /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 11:12:50.236549 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ecaea6a6-fa36-4813-934c-2baf22751321 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:50.237281 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ecaea6a6-fa36-4813-934c-2baf22751321 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:50.245041 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ecaea6a6-fa36-4813-934c-2baf22751321 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:50.245745 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ecaea6a6-fa36-4813-934c-2baf22751321 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:50.246014 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ecaea6a6-fa36-4813-934c-2baf22751321 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:50.246737 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ecaea6a6-fa36-4813-934c-2baf22751321 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:50.247200 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ecaea6a6-fa36-4813-934c-2baf22751321 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:50.247631 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ecaea6a6-fa36-4813-934c-2baf22751321 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:50.388684 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ecaea6a6-fa36-4813-934c-2baf22751321 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:12:50.404138 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ecaea6a6-fa36-4813-934c-2baf22751321 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:12:50.407961 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ecaea6a6-fa36-4813-934c-2baf22751321 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:12:50.409997 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ecaea6a6-fa36-4813-934c-2baf22751321 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1723 microversion: 2.20 time: 0.178152 Aug 31 11:12:50.411008 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 500/929] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:12:50 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:12:51.446383 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8ba63f9e-072a-4679-9770-341eccc5b4c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:51.447273 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8ba63f9e-072a-4679-9770-341eccc5b4c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:51.453938 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ba63f9e-072a-4679-9770-341eccc5b4c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:51.454695 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ba63f9e-072a-4679-9770-341eccc5b4c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:51.455129 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ba63f9e-072a-4679-9770-341eccc5b4c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:51.455812 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ba63f9e-072a-4679-9770-341eccc5b4c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:51.456482 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ba63f9e-072a-4679-9770-341eccc5b4c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:51.456904 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8ba63f9e-072a-4679-9770-341eccc5b4c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:51.596507 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8ba63f9e-072a-4679-9770-341eccc5b4c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:12:51.604624 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8ba63f9e-072a-4679-9770-341eccc5b4c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:12:51.606093 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-8ba63f9e-072a-4679-9770-341eccc5b4c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:12:51.611543 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8ba63f9e-072a-4679-9770-341eccc5b4c8 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1723 microversion: 2.20 time: 0.170072 Aug 31 11:12:51.612125 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 430/930] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:12:51 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:12:52.028602 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c19d5a35-8b00-4468-928e-407f3c1254d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:52.030038 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c19d5a35-8b00-4468-928e-407f3c1254d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:52.037553 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c19d5a35-8b00-4468-928e-407f3c1254d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:52.038292 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c19d5a35-8b00-4468-928e-407f3c1254d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:52.038805 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c19d5a35-8b00-4468-928e-407f3c1254d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:52.039706 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c19d5a35-8b00-4468-928e-407f3c1254d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:52.040395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c19d5a35-8b00-4468-928e-407f3c1254d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:52.041004 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c19d5a35-8b00-4468-928e-407f3c1254d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:52.066177 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c19d5a35-8b00-4468-928e-407f3c1254d3 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/ips" status: 200 len: 145 microversion: 2.1 time: 0.250727 Aug 31 11:12:52.066742 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 501/931] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 11:12:51 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/ips => generated 145 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:12:52.637269 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-0105c8ca-5e8b-4858-8629-6a6ab658b98a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:52.638547 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-0105c8ca-5e8b-4858-8629-6a6ab658b98a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:52.647268 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0105c8ca-5e8b-4858-8629-6a6ab658b98a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:52.648763 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0105c8ca-5e8b-4858-8629-6a6ab658b98a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:52.649592 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0105c8ca-5e8b-4858-8629-6a6ab658b98a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:52.650418 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0105c8ca-5e8b-4858-8629-6a6ab658b98a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:52.651144 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0105c8ca-5e8b-4858-8629-6a6ab658b98a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:52.651768 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-0105c8ca-5e8b-4858-8629-6a6ab658b98a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:52.669357 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-47160265-551e-43ae-b524-089b3200c43b req-10b3a23d-0aa7-4590-ac06-d74f9284b2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8572f06c-5fe1-4496-b9e7-92ae0d9b6b84", "name": "network-vif-deleted", "tag": "61614d6e-8cbb-415d-9054-acb80c091e6f"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:12:52.692893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-47160265-551e-43ae-b524-089b3200c43b req-10b3a23d-0aa7-4590-ac06-d74f9284b2bc service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:52.693370 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-47160265-551e-43ae-b524-089b3200c43b req-10b3a23d-0aa7-4590-ac06-d74f9284b2bc service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:52.708198 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-47160265-551e-43ae-b524-089b3200c43b req-10b3a23d-0aa7-4590-ac06-d74f9284b2bc service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:52.743932 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-47160265-551e-43ae-b524-089b3200c43b req-10b3a23d-0aa7-4590-ac06-d74f9284b2bc service nova] Creating event network-vif-deleted:61614d6e-8cbb-415d-9054-acb80c091e6f for instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 on hv-cinder-85535 Aug 31 11:12:52.761856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-47160265-551e-43ae-b524-089b3200c43b req-10b3a23d-0aa7-4590-ac06-d74f9284b2bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096419 Aug 31 11:12:52.763010 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 502/932] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:12:52.783252 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0105c8ca-5e8b-4858-8629-6a6ab658b98a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:12:52.799540 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0105c8ca-5e8b-4858-8629-6a6ab658b98a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:12:52.801437 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-0105c8ca-5e8b-4858-8629-6a6ab658b98a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '714872990c384663bcd564cd5b9ae432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25cd48f364541dbaceabdac555bb343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:12:52.802911 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-0105c8ca-5e8b-4858-8629-6a6ab658b98a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 200 len: 1656 microversion: 2.20 time: 0.171176 Aug 31 11:12:52.804216 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 431/933] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:12:52 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 1656 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:12:53.483586 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6ab5ed43-4717-48fc-b986-a61009bc6022 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34a48581-cae3-49eb-9519-d6dcb1dfcd7c"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:12:53.486115 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6ab5ed43-4717-48fc-b986-a61009bc6022 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:53.494159 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6ab5ed43-4717-48fc-b986-a61009bc6022 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:53.494964 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6ab5ed43-4717-48fc-b986-a61009bc6022 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:53.495400 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6ab5ed43-4717-48fc-b986-a61009bc6022 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:53.496808 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6ab5ed43-4717-48fc-b986-a61009bc6022 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:53.497242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6ab5ed43-4717-48fc-b986-a61009bc6022 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:53.497856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6ab5ed43-4717-48fc-b986-a61009bc6022 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:53.784278 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6ab5ed43-4717-48fc-b986-a61009bc6022 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "POST /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305654 Aug 31 11:12:53.785328 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 503/934] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:12:53 2022] POST /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:12:53.832049 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cbc210fe-a798-4920-b347-b916e38fd312 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:53.837808 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-cbc210fe-a798-4920-b347-b916e38fd312 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:53.865736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cbc210fe-a798-4920-b347-b916e38fd312 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:53.868161 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cbc210fe-a798-4920-b347-b916e38fd312 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:53.869333 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cbc210fe-a798-4920-b347-b916e38fd312 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:53.872243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cbc210fe-a798-4920-b347-b916e38fd312 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:53.873691 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cbc210fe-a798-4920-b347-b916e38fd312 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:53.874390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cbc210fe-a798-4920-b347-b916e38fd312 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:53.899146 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-cbc210fe-a798-4920-b347-b916e38fd312 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] HTTP exception thrown: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cbc210fe-a798-4920-b347-b916e38fd312 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Request method failure captured: Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 HTTP/1.1 Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0CCDoLHRIHvGgX_OnISg4UCwHHo-6LEqKpw3jyj95tS4Jw9832NzJkePB1554MUZYHOXVWCDQrkG5Xi2H7ZcYwuZPX17G9K6AVIPCtUMP8g4PD6xV5xGeOWcGWKi5NARHHidUBX6q2Z_zzj3zAmU2uEkbtAsDODDUpojUv89rH5tJA Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: a25cd48f364541dbaceabdac555bb343 Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:12:53.901099 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:12:53.903263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25cd48f364541dbaceabdac555bb343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25cd48f364541dbaceabdac555bb343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25cd48f364541dbaceabdac555bb343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25cd48f364541dbaceabdac555bb343"}]}] Aug 31 11:12:53.903263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:53.903263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: a25cd48f364541dbaceabdac555bb343 Aug 31 11:12:53.903263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:53.903263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeShelveTestJSON-588349330-project Aug 31 11:12:53.903263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:12:53.903263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:12:53.903263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 714872990c384663bcd564cd5b9ae432 Aug 31 11:12:53.903263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeShelveTestJSON-588349330-project Aug 31 11:12:53.903263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:12:53.903263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:53.903263 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '8572f06c-5fe1-4496-b9e7-92ae0d9b6b84'} Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:53.905126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:53.906660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:53.909837 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cbc210fe-a798-4920-b347-b916e38fd312 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Returning 404 to user: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:53.909837 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-cbc210fe-a798-4920-b347-b916e38fd312 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 404 len: 111 microversion: 2.20 time: 0.080029 Aug 31 11:12:53.909837 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 432/935] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:12:53 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:12:53.914300 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8f528cb7-f388-467e-a910-365676e50c76 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '.version_select at 0x7f732d3fd1f0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:53.939258 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8f528cb7-f388-467e-a910-365676e50c76 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-196370830" status: 204 len: 0 microversion: 2.20 time: 0.029791 Aug 31 11:12:53.940547 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 504/936] 10.222.0.20 () {60 vars in 1259 bytes} [Wed Aug 31 11:12:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-196370830 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 11:12:55.912256 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f1652914-f05c-4ab5-b629-bb1fd1033a2a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:55.913327 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-f1652914-f05c-4ab5-b629-bb1fd1033a2a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:55.919848 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f1652914-f05c-4ab5-b629-bb1fd1033a2a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:55.920367 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f1652914-f05c-4ab5-b629-bb1fd1033a2a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:55.920820 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f1652914-f05c-4ab5-b629-bb1fd1033a2a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:55.921526 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f1652914-f05c-4ab5-b629-bb1fd1033a2a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:55.922136 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f1652914-f05c-4ab5-b629-bb1fd1033a2a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:55.922514 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f1652914-f05c-4ab5-b629-bb1fd1033a2a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:55.936626 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-f1652914-f05c-4ab5-b629-bb1fd1033a2a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] HTTP exception thrown: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f1652914-f05c-4ab5-b629-bb1fd1033a2a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Request method failure captured: Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: DELETE /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 HTTP/1.1 Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0CCDoLHRIHvGgX_OnISg4UCwHHo-6LEqKpw3jyj95tS4Jw9832NzJkePB1554MUZYHOXVWCDQrkG5Xi2H7ZcYwuZPX17G9K6AVIPCtUMP8g4PD6xV5xGeOWcGWKi5NARHHidUBX6q2Z_zzj3zAmU2uEkbtAsDODDUpojUv89rH5tJA Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: a25cd48f364541dbaceabdac555bb343 Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:12:55.938292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:12:55.939946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25cd48f364541dbaceabdac555bb343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25cd48f364541dbaceabdac555bb343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25cd48f364541dbaceabdac555bb343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25cd48f364541dbaceabdac555bb343"}]}] Aug 31 11:12:55.939946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:55.939946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: a25cd48f364541dbaceabdac555bb343 Aug 31 11:12:55.939946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:55.939946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeShelveTestJSON-588349330-project Aug 31 11:12:55.939946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:12:55.939946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:12:55.939946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 714872990c384663bcd564cd5b9ae432 Aug 31 11:12:55.939946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeShelveTestJSON-588349330-project Aug 31 11:12:55.939946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:12:55.939946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:55.939946 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '8572f06c-5fe1-4496-b9e7-92ae0d9b6b84'} Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:55.940856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:55.942313 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:55.944708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f1652914-f05c-4ab5-b629-bb1fd1033a2a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Returning 404 to user: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:55.945561 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-f1652914-f05c-4ab5-b629-bb1fd1033a2a tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 404 len: 111 microversion: 2.20 time: 0.037178 Aug 31 11:12:55.946293 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 433/937] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 31 11:12:55 2022] DELETE /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:12:55.955162 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-32cd9d65-bb61-448b-afae-2d06b784b839 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:55.956056 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-32cd9d65-bb61-448b-afae-2d06b784b839 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:55.963616 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32cd9d65-bb61-448b-afae-2d06b784b839 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:55.964343 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32cd9d65-bb61-448b-afae-2d06b784b839 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:55.964969 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32cd9d65-bb61-448b-afae-2d06b784b839 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:55.965700 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32cd9d65-bb61-448b-afae-2d06b784b839 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:55.966397 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32cd9d65-bb61-448b-afae-2d06b784b839 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:55.967234 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-32cd9d65-bb61-448b-afae-2d06b784b839 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:55.981389 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-32cd9d65-bb61-448b-afae-2d06b784b839 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] HTTP exception thrown: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-32cd9d65-bb61-448b-afae-2d06b784b839 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Request method failure captured: Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 HTTP/1.1 Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0CCDoLHRIHvGgX_OnISg4UCwHHo-6LEqKpw3jyj95tS4Jw9832NzJkePB1554MUZYHOXVWCDQrkG5Xi2H7ZcYwuZPX17G9K6AVIPCtUMP8g4PD6xV5xGeOWcGWKi5NARHHidUBX6q2Z_zzj3zAmU2uEkbtAsDODDUpojUv89rH5tJA Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: a25cd48f364541dbaceabdac555bb343 Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:12:55.983095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:12:55.984567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25cd48f364541dbaceabdac555bb343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25cd48f364541dbaceabdac555bb343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25cd48f364541dbaceabdac555bb343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25cd48f364541dbaceabdac555bb343"}]}] Aug 31 11:12:55.984567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:55.984567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: a25cd48f364541dbaceabdac555bb343 Aug 31 11:12:55.984567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:55.984567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-AttachVolumeShelveTestJSON-588349330-project Aug 31 11:12:55.984567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:12:55.984567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:12:55.984567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 714872990c384663bcd564cd5b9ae432 Aug 31 11:12:55.984567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-AttachVolumeShelveTestJSON-588349330-project Aug 31 11:12:55.984567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:12:55.984567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:55.984567 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '8572f06c-5fe1-4496-b9e7-92ae0d9b6b84'} Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:55.988578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. Aug 31 11:12:55.989924 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:55.991459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-32cd9d65-bb61-448b-afae-2d06b784b839 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Returning 404 to user: Instance 8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:55.991459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-32cd9d65-bb61-448b-afae-2d06b784b839 tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84" status: 404 len: 111 microversion: 2.20 time: 0.034152 Aug 31 11:12:55.991459 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 505/938] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:12:55 2022] GET /compute/v2.1/servers/8572f06c-5fe1-4496-b9e7-92ae0d9b6b84 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:12:57.135221 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-31690ced-4fe6-421a-a97b-ca24117d420e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:57.135726 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-31690ced-4fe6-421a-a97b-ca24117d420e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:57.142885 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-31690ced-4fe6-421a-a97b-ca24117d420e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:57.143395 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-31690ced-4fe6-421a-a97b-ca24117d420e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:57.143857 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-31690ced-4fe6-421a-a97b-ca24117d420e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:57.144674 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-31690ced-4fe6-421a-a97b-ca24117d420e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:57.145042 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-31690ced-4fe6-421a-a97b-ca24117d420e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:57.145455 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-31690ced-4fe6-421a-a97b-ca24117d420e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:57.160232 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-31690ced-4fe6-421a-a97b-ca24117d420e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] HTTP exception thrown: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-31690ced-4fe6-421a-a97b-ca24117d420e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Request method failure captured: Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: DELETE /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e HTTP/1.1 Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0CCDoLHRIHvGgX_OnISg4UCwHHo-6LEqKpw3jyj95tS4Jw9832NzJkePB1554MUZYHOXVWCDQrkG5Xi2H7ZcYwuZPX17G9K6AVIPCtUMP8g4PD6xV5xGeOWcGWKi5NARHHidUBX6q2Z_zzj3zAmU2uEkbtAsDODDUpojUv89rH5tJA Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: a25cd48f364541dbaceabdac555bb343 Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:12:57.161835 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:12:57.163414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25cd48f364541dbaceabdac555bb343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25cd48f364541dbaceabdac555bb343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25cd48f364541dbaceabdac555bb343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25cd48f364541dbaceabdac555bb343"}]}] Aug 31 11:12:57.163414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:57.163414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: a25cd48f364541dbaceabdac555bb343 Aug 31 11:12:57.163414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:57.163414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeShelveTestJSON-588349330-project Aug 31 11:12:57.163414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:12:57.163414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:12:57.163414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 714872990c384663bcd564cd5b9ae432 Aug 31 11:12:57.163414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeShelveTestJSON-588349330-project Aug 31 11:12:57.163414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:12:57.163414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:12:57.163414 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e'} Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:57.164359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:12:57.165710 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:12:57.167103 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-31690ced-4fe6-421a-a97b-ca24117d420e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Returning 404 to user: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:57.167103 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-31690ced-4fe6-421a-a97b-ca24117d420e tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 404 len: 111 microversion: 2.20 time: 0.032195 Aug 31 11:12:57.167103 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 434/939] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 31 11:12:57 2022] DELETE /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:12:57.172684 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-239fe919-f691-497b-b967-519a4513fbdd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:12:57.173301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-239fe919-f691-497b-b967-519a4513fbdd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] [instance: 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:12:57.179880 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-239fe919-f691-497b-b967-519a4513fbdd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:57.180505 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-239fe919-f691-497b-b967-519a4513fbdd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:57.180967 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-239fe919-f691-497b-b967-519a4513fbdd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:57.181690 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-239fe919-f691-497b-b967-519a4513fbdd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:12:57.182141 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-239fe919-f691-497b-b967-519a4513fbdd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:12:57.182549 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-239fe919-f691-497b-b967-519a4513fbdd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:12:57.196701 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-239fe919-f691-497b-b967-519a4513fbdd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] HTTP exception thrown: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-239fe919-f691-497b-b967-519a4513fbdd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Request method failure captured: Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e HTTP/1.1 Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0CCDoLHRIHvGgX_OnISg4UCwHHo-6LEqKpw3jyj95tS4Jw9832NzJkePB1554MUZYHOXVWCDQrkG5Xi2H7ZcYwuZPX17G9K6AVIPCtUMP8g4PD6xV5xGeOWcGWKi5NARHHidUBX6q2Z_zzj3zAmU2uEkbtAsDODDUpojUv89rH5tJA Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: a25cd48f364541dbaceabdac555bb343 Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:12:57.198339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:12:57.199919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25cd48f364541dbaceabdac555bb343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25cd48f364541dbaceabdac555bb343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25cd48f364541dbaceabdac555bb343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25cd48f364541dbaceabdac555bb343"}]}] Aug 31 11:12:57.199919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:57.199919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: a25cd48f364541dbaceabdac555bb343 Aug 31 11:12:57.199919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-588349330 Aug 31 11:12:57.199919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-AttachVolumeShelveTestJSON-588349330-project Aug 31 11:12:57.199919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:12:57.199919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:12:57.199919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 714872990c384663bcd564cd5b9ae432 Aug 31 11:12:57.199919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-AttachVolumeShelveTestJSON-588349330-project Aug 31 11:12:57.199919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:12:57.199919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:12:57.199919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e'} Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:12:57.200754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. Aug 31 11:12:57.202299 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:12:57.203426 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-239fe919-f691-497b-b967-519a4513fbdd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] Returning 404 to user: Instance 3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:12:57.203426 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-239fe919-f691-497b-b967-519a4513fbdd tempest-AttachVolumeShelveTestJSON-588349330 tempest-AttachVolumeShelveTestJSON-588349330-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e" status: 404 len: 111 microversion: 2.20 time: 0.031760 Aug 31 11:12:57.203426 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 506/940] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 11:12:57 2022] GET /compute/v2.1/servers/3ebbb8e5-d3b4-4dad-aa63-7f7ba808c88e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:13:00.407041 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d5dbb6a5-74b8-4831-8d55-cfafe8fedf9e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:00.409454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d5dbb6a5-74b8-4831-8d55-cfafe8fedf9e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:00.417247 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5dbb6a5-74b8-4831-8d55-cfafe8fedf9e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:00.417746 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5dbb6a5-74b8-4831-8d55-cfafe8fedf9e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:00.418188 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5dbb6a5-74b8-4831-8d55-cfafe8fedf9e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:00.418901 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5dbb6a5-74b8-4831-8d55-cfafe8fedf9e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:00.419354 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5dbb6a5-74b8-4831-8d55-cfafe8fedf9e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:00.419814 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5dbb6a5-74b8-4831-8d55-cfafe8fedf9e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:00.458416 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d5dbb6a5-74b8-4831-8d55-cfafe8fedf9e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057088 Aug 31 11:13:00.459144 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 435/941] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:13:00 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:00.478750 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-45578387-187b-4988-8526-04d3ddaa56bc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:00.479316 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-45578387-187b-4988-8526-04d3ddaa56bc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:00.486432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45578387-187b-4988-8526-04d3ddaa56bc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:00.487199 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45578387-187b-4988-8526-04d3ddaa56bc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:00.487879 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45578387-187b-4988-8526-04d3ddaa56bc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:00.488625 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45578387-187b-4988-8526-04d3ddaa56bc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:00.489291 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45578387-187b-4988-8526-04d3ddaa56bc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:00.489849 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-45578387-187b-4988-8526-04d3ddaa56bc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:00.525859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-45578387-187b-4988-8526-04d3ddaa56bc tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments/34a48581-cae3-49eb-9519-d6dcb1dfcd7c" status: 200 len: 194 microversion: 2.1 time: 0.059105 Aug 31 11:13:00.526884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 507/942] 10.222.0.20 () {58 vars in 1413 bytes} [Wed Aug 31 11:13:00 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments/34a48581-cae3-49eb-9519-d6dcb1dfcd7c => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:01.974886 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-29310ed6-1907-4ed4-9c70-b9c83f133247 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28acbadf-3187-49db-8896-e5bcd72a0708"}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:13:01.977274 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-29310ed6-1907-4ed4-9c70-b9c83f133247 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:01.983790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-29310ed6-1907-4ed4-9c70-b9c83f133247 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:01.984329 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-29310ed6-1907-4ed4-9c70-b9c83f133247 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:01.984767 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-29310ed6-1907-4ed4-9c70-b9c83f133247 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:01.985468 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-29310ed6-1907-4ed4-9c70-b9c83f133247 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:01.986025 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-29310ed6-1907-4ed4-9c70-b9c83f133247 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:01.986410 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-29310ed6-1907-4ed4-9c70-b9c83f133247 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:02.273065 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-29310ed6-1907-4ed4-9c70-b9c83f133247 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "POST /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302145 Aug 31 11:13:02.273693 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 436/943] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:13:01 2022] POST /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:02.430289 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-01dd54bd-1e33-470d-98e4-d386593958b9 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Action: 'create', calling method: .version_select at 0x7f732d3fdca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-524045655"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:13:02.741599 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-01dd54bd-1e33-470d-98e4-d386593958b9 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.451559 Aug 31 11:13:02.742400 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 508/944] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Aug 31 11:13:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 453 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 11:13:02.757256 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-73456961-35d9-4881-94a3-032ad60b790b tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d2c91f0>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:02.823511 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-73456961-35d9-4881-94a3-032ad60b790b tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22" status: 200 len: 344 microversion: 2.1 time: 0.070529 Aug 31 11:13:02.824105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 437/945] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:13:02 2022] GET /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22 => generated 344 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:03.838597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e894b3f1-9e29-4cd3-93a8-3ff236e78fc1 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d187f70>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:03.890689 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e894b3f1-9e29-4cd3-93a8-3ff236e78fc1 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22" status: 200 len: 345 microversion: 2.1 time: 0.056221 Aug 31 11:13:03.891312 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 509/946] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:13:03 2022] GET /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:03.905403 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b83ef7b1-c80e-4601-8bcf-ff4ae06a9cee tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Action: 'create', calling method: .version_select at 0x7f732d2c2c10>, body: {"snapshot": {"volume_id": "2bc366e0-0abf-40a1-b1e6-8620666e8f22", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-446649124"}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:13:04.063167 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b83ef7b1-c80e-4601-8bcf-ff4ae06a9cee tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.163129 Aug 31 11:13:04.063824 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 438/947] 10.222.0.20 () {60 vars in 1162 bytes} [Wed Aug 31 11:13:03 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:04.076896 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8858de11-618b-41ae-8db4-0536172f2934 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d3fdca0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:04.106788 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8858de11-618b-41ae-8db4-0536172f2934 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d" status: 200 len: 286 microversion: 2.1 time: 0.034882 Aug 31 11:13:04.107944 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 510/948] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 11:13:04 2022] GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:04.119251 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-370a5186-3def-461b-bd85-3306e69e2323 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d65d0d0>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:04.151089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-370a5186-3def-461b-bd85-3306e69e2323 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035868 Aug 31 11:13:04.151683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 439/949] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Aug 31 11:13:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:04.162944 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-70c657d6-5f81-46a9-83e7-d24ab5337c27 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d3b0ee0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:04.192736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-70c657d6-5f81-46a9-83e7-d24ab5337c27 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d" status: 200 len: 286 microversion: 2.1 time: 0.033512 Aug 31 11:13:04.193317 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 511/950] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 11:13:04 2022] GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:05.205966 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8d4e4f6c-f47b-4796-8020-8d9384b37485 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d306e50>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:05.236289 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8d4e4f6c-f47b-4796-8020-8d9384b37485 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d" status: 200 len: 286 microversion: 2.1 time: 0.034663 Aug 31 11:13:05.236857 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 440/951] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 11:13:05 2022] GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:06.250288 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-acfc7ad0-5195-47df-a5fa-3754b0ac7062 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d4bc790>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:06.279965 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-acfc7ad0-5195-47df-a5fa-3754b0ac7062 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d" status: 200 len: 286 microversion: 2.1 time: 0.033185 Aug 31 11:13:06.280551 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 512/952] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 11:13:06 2022] GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:07.293205 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d7739520-854a-47a9-baca-55d3e482d484 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d196310>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:07.325314 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d7739520-854a-47a9-baca-55d3e482d484 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d" status: 200 len: 287 microversion: 2.1 time: 0.036446 Aug 31 11:13:07.326151 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 441/953] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 11:13:07 2022] GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:07.338063 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b3094607-5ed1-4c75-beab-fb4b120ace22 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d187940>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:07.399291 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b3094607-5ed1-4c75-beab-fb4b120ace22 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d" status: 202 len: 0 microversion: 2.1 time: 0.064895 Aug 31 11:13:07.400241 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 513/954] 10.222.0.20 () {58 vars in 1254 bytes} [Wed Aug 31 11:13:07 2022] DELETE /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:13:07.414217 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1b67dfb5-26c4-4789-b81f-d439501a593f tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d196160>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:07.455068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-1b67dfb5-26c4-4789-b81f-d439501a593f tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d" status: 200 len: 286 microversion: 2.1 time: 0.047725 Aug 31 11:13:07.455652 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 442/955] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 11:13:07 2022] GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:08.468762 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b52539c4-86e8-47b2-9078-0b329106d37e tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d3b0af0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:08.495695 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-b52539c4-86e8-47b2-9078-0b329106d37e tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] HTTP exception thrown: Snapshot 2fa49a95-c5a5-4953-b961-beab545a5e4d could not be found. Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b52539c4-86e8-47b2-9078-0b329106d37e tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Request method failure captured: Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d HTTP/1.1 Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0I-njUsqfaUuzr8bB0NVFO5yWFdFwqrlfkOpDLWauWlyVB8dMBcUXkfTj6knfivzMH0bqDO04UAH5f84epf4csICQy92nYaOPjDPRqD-BpAVxB5Z4WkYOwBv9h-pg5VCL9J4UJUHOu7a94v1hZR6ThuR-NGkTYrmL-P3825SXQVddg Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 8ae1e2afc0894009aca8e419950c4703 Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1032016932 Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:13:08.498020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ae1e2afc0894009aca8e419950c4703"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ae1e2afc0894009aca8e419950c4703"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ae1e2afc0894009aca8e419950c4703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ae1e2afc0894009aca8e419950c4703"}]}] Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1032016932 Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 8ae1e2afc0894009aca8e419950c4703 Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1032016932 Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-VolumesSnapshotsTestJSON-1032016932-project Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 4b48479848c54c059655e11a169ddaf4 Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1032016932-project Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Snapshot 2fa49a95-c5a5-4953-b961-beab545a5e4d could not be found. Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '2fa49a95-c5a5-4953-b961-beab545a5e4d'} Aug 31 11:13:08.501065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2fa49a95-c5a5-4953-b961-beab545a5e4d could not be found. (HTTP 404) (Request-ID: req-99198dde-27f6-41c9-8d1a-e3c410b3e5fc) Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:08.502136 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:13:08.503698 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2fa49a95-c5a5-4953-b961-beab545a5e4d could not be found. Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 11:13:08.505450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2fa49a95-c5a5-4953-b961-beab545a5e4d could not be found. Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2fa49a95-c5a5-4953-b961-beab545a5e4d could not be found. Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b52539c4-86e8-47b2-9078-0b329106d37e tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Returning 404 to user: Snapshot 2fa49a95-c5a5-4953-b961-beab545a5e4d could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:13:08.506926 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b52539c4-86e8-47b2-9078-0b329106d37e tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d" status: 404 len: 111 microversion: 2.1 time: 0.037014 Aug 31 11:13:08.512043 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 514/956] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 11:13:08 2022] GET /compute/v2.1/os-snapshots/2fa49a95-c5a5-4953-b961-beab545a5e4d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:13:08.512141 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4cbf158d-f8f4-40b0-8c90-0a3d5556bf5d tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d2c9820>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:08.570360 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4cbf158d-f8f4-40b0-8c90-0a3d5556bf5d tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22" status: 202 len: 0 microversion: 2.1 time: 0.065166 Aug 31 11:13:08.570932 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 443/957] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 11:13:08 2022] DELETE /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:13:08.579740 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a68dfb01-99d5-4862-861d-f1031a6c2508 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d2d14c0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:08.633469 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a68dfb01-99d5-4862-861d-f1031a6c2508 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22" status: 200 len: 344 microversion: 2.1 time: 0.057093 Aug 31 11:13:08.633469 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 515/958] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:13:08 2022] GET /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:09.649843 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a7e81629-ae12-4b48-b515-0214abd5c23c tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d3b93a0>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:09.679166 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-a7e81629-ae12-4b48-b515-0214abd5c23c tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] HTTP exception thrown: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a7e81629-ae12-4b48-b515-0214abd5c23c tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Request method failure captured: Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22 HTTP/1.1 Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0I-njUsqfaUuzr8bB0NVFO5yWFdFwqrlfkOpDLWauWlyVB8dMBcUXkfTj6knfivzMH0bqDO04UAH5f84epf4csICQy92nYaOPjDPRqD-BpAVxB5Z4WkYOwBv9h-pg5VCL9J4UJUHOu7a94v1hZR6ThuR-NGkTYrmL-P3825SXQVddg Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 8ae1e2afc0894009aca8e419950c4703 Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1032016932 Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:13:09.681280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ae1e2afc0894009aca8e419950c4703"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ae1e2afc0894009aca8e419950c4703"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ae1e2afc0894009aca8e419950c4703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ae1e2afc0894009aca8e419950c4703"}]}] Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1032016932 Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 8ae1e2afc0894009aca8e419950c4703 Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1032016932 Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-VolumesSnapshotsTestJSON-1032016932-project Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 4b48479848c54c059655e11a169ddaf4 Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1032016932-project Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '2bc366e0-0abf-40a1-b1e6-8620666e8f22'} Aug 31 11:13:09.682991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. (HTTP 404) (Request-ID: req-5d1119f6-61c1-4210-bb1c-8c7bcc7c9e4c) Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:09.684791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:13:09.687603 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 11:13:09.689322 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a7e81629-ae12-4b48-b515-0214abd5c23c tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Returning 404 to user: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a7e81629-ae12-4b48-b515-0214abd5c23c tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22" status: 404 len: 109 microversion: 2.1 time: 0.037844 Aug 31 11:13:09.690577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 444/959] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:13:09 2022] GET /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:13:09.697353 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-885122f0-28cd-4796-a0f3-d94b3cca12e6 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d3b08b0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:09.725719 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-885122f0-28cd-4796-a0f3-d94b3cca12e6 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] HTTP exception thrown: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-885122f0-28cd-4796-a0f3-d94b3cca12e6 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Request method failure captured: Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: DELETE /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22 HTTP/1.1 Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0I-njUsqfaUuzr8bB0NVFO5yWFdFwqrlfkOpDLWauWlyVB8dMBcUXkfTj6knfivzMH0bqDO04UAH5f84epf4csICQy92nYaOPjDPRqD-BpAVxB5Z4WkYOwBv9h-pg5VCL9J4UJUHOu7a94v1hZR6ThuR-NGkTYrmL-P3825SXQVddg Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 8ae1e2afc0894009aca8e419950c4703 Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1032016932 Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:13:09.727640 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ae1e2afc0894009aca8e419950c4703"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ae1e2afc0894009aca8e419950c4703"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ae1e2afc0894009aca8e419950c4703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ae1e2afc0894009aca8e419950c4703"}]}] Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1032016932 Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 8ae1e2afc0894009aca8e419950c4703 Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1032016932 Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-VolumesSnapshotsTestJSON-1032016932-project Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 4b48479848c54c059655e11a169ddaf4 Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1032016932-project Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '2bc366e0-0abf-40a1-b1e6-8620666e8f22'} Aug 31 11:13:09.729449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. (HTTP 404) (Request-ID: req-cd5eeddb-5990-4884-881d-ee2ed0d0ce9f) Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:09.730405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:13:09.731810 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 11:13:09.733859 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-885122f0-28cd-4796-a0f3-d94b3cca12e6 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Returning 404 to user: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-885122f0-28cd-4796-a0f3-d94b3cca12e6 tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22" status: 404 len: 109 microversion: 2.1 time: 0.035972 Aug 31 11:13:09.735989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 516/960] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 11:13:09 2022] DELETE /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:13:09.737674 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-523bf90c-6d38-4db1-8707-83f81e38993e tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Calling method '.version_select at 0x7f732d2e5f70>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:09.767575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-523bf90c-6d38-4db1-8707-83f81e38993e tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] HTTP exception thrown: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-523bf90c-6d38-4db1-8707-83f81e38993e tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Request method failure captured: Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22 HTTP/1.1 Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0I-njUsqfaUuzr8bB0NVFO5yWFdFwqrlfkOpDLWauWlyVB8dMBcUXkfTj6knfivzMH0bqDO04UAH5f84epf4csICQy92nYaOPjDPRqD-BpAVxB5Z4WkYOwBv9h-pg5VCL9J4UJUHOu7a94v1hZR6ThuR-NGkTYrmL-P3825SXQVddg Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 8ae1e2afc0894009aca8e419950c4703 Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1032016932 Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:13:09.771098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ae1e2afc0894009aca8e419950c4703"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ae1e2afc0894009aca8e419950c4703"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ae1e2afc0894009aca8e419950c4703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ae1e2afc0894009aca8e419950c4703"}]}] Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1032016932 Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 8ae1e2afc0894009aca8e419950c4703 Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1032016932 Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-VolumesSnapshotsTestJSON-1032016932-project Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 4b48479848c54c059655e11a169ddaf4 Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1032016932-project Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '2bc366e0-0abf-40a1-b1e6-8620666e8f22'} Aug 31 11:13:09.772747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. (HTTP 404) (Request-ID: req-9750402b-a0c4-40ec-9ce0-302ed42a74e8) Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:09.773579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:13:09.775924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 11:13:09.778074 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:13:09.783738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.783738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.783738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:09.783738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.783738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:09.783738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:09.783738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:09.783738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:13:09.783738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:13:09.783738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. Aug 31 11:13:09.783738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:09.783738 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-523bf90c-6d38-4db1-8707-83f81e38993e tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] Returning 404 to user: Volume 2bc366e0-0abf-40a1-b1e6-8620666e8f22 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:13:09.785035 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-523bf90c-6d38-4db1-8707-83f81e38993e tempest-VolumesSnapshotsTestJSON-1032016932 tempest-VolumesSnapshotsTestJSON-1032016932-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22" status: 404 len: 109 microversion: 2.1 time: 0.047057 Aug 31 11:13:09.785927 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 445/961] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:13:09 2022] GET /compute/v2.1/os-volumes/2bc366e0-0abf-40a1-b1e6-8620666e8f22 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:13:09.826946 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1af73e0c-7061-4f08-99fd-df300c18cf2d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:09.829674 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1af73e0c-7061-4f08-99fd-df300c18cf2d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:09.835537 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1af73e0c-7061-4f08-99fd-df300c18cf2d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:09.836039 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1af73e0c-7061-4f08-99fd-df300c18cf2d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:09.836480 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1af73e0c-7061-4f08-99fd-df300c18cf2d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:09.837165 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1af73e0c-7061-4f08-99fd-df300c18cf2d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:09.837618 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1af73e0c-7061-4f08-99fd-df300c18cf2d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:09.838035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1af73e0c-7061-4f08-99fd-df300c18cf2d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:09.868829 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1af73e0c-7061-4f08-99fd-df300c18cf2d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045752 Aug 31 11:13:09.869396 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 517/962] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:13:09 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:10.010481 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c94c393a-d513-4a33-90f9-d9137a82305b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:10.011112 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c94c393a-d513-4a33-90f9-d9137a82305b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:10.017909 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c94c393a-d513-4a33-90f9-d9137a82305b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:10.018399 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c94c393a-d513-4a33-90f9-d9137a82305b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:10.018841 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c94c393a-d513-4a33-90f9-d9137a82305b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:10.019549 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c94c393a-d513-4a33-90f9-d9137a82305b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:10.020027 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c94c393a-d513-4a33-90f9-d9137a82305b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:10.020462 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-c94c393a-d513-4a33-90f9-d9137a82305b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:10.051125 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c94c393a-d513-4a33-90f9-d9137a82305b tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments/34a48581-cae3-49eb-9519-d6dcb1dfcd7c" status: 200 len: 194 microversion: 2.1 time: 0.045253 Aug 31 11:13:10.051730 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 446/963] 10.222.0.20 () {58 vars in 1413 bytes} [Wed Aug 31 11:13:10 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments/34a48581-cae3-49eb-9519-d6dcb1dfcd7c => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:10.062483 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ce38d81b-d08e-4f75-b996-a5cf47d04e6d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:10.062982 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ce38d81b-d08e-4f75-b996-a5cf47d04e6d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:10.069143 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ce38d81b-d08e-4f75-b996-a5cf47d04e6d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:10.069632 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ce38d81b-d08e-4f75-b996-a5cf47d04e6d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:10.070072 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ce38d81b-d08e-4f75-b996-a5cf47d04e6d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:10.070779 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ce38d81b-d08e-4f75-b996-a5cf47d04e6d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:10.071237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ce38d81b-d08e-4f75-b996-a5cf47d04e6d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:10.071663 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ce38d81b-d08e-4f75-b996-a5cf47d04e6d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:10.160772 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-ce38d81b-d08e-4f75-b996-a5cf47d04e6d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lazy-loading 'services' on Instance uuid e8ae93cb-bdd8-4d6a-85f5-52918c72f87b {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:13:10.235645 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ce38d81b-d08e-4f75-b996-a5cf47d04e6d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments/34a48581-cae3-49eb-9519-d6dcb1dfcd7c" status: 202 len: 0 microversion: 2.1 time: 0.176956 Aug 31 11:13:10.236276 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 518/964] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 11:13:10 2022] DELETE /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments/34a48581-cae3-49eb-9519-d6dcb1dfcd7c => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:13:12.438402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-f47800c5-bb08-45d2-b497-3a559c452fe5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:12.438917 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-f47800c5-bb08-45d2-b497-3a559c452fe5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:12.445391 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f47800c5-bb08-45d2-b497-3a559c452fe5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:12.445868 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f47800c5-bb08-45d2-b497-3a559c452fe5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:12.446302 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f47800c5-bb08-45d2-b497-3a559c452fe5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:12.446993 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f47800c5-bb08-45d2-b497-3a559c452fe5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:12.447442 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f47800c5-bb08-45d2-b497-3a559c452fe5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:12.447863 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-f47800c5-bb08-45d2-b497-3a559c452fe5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:12.476921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-f47800c5-bb08-45d2-b497-3a559c452fe5 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments/28acbadf-3187-49db-8896-e5bcd72a0708" status: 200 len: 194 microversion: 2.1 time: 0.042443 Aug 31 11:13:12.477499 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 447/965] 10.222.0.20 () {58 vars in 1413 bytes} [Wed Aug 31 11:13:12 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments/28acbadf-3187-49db-8896-e5bcd72a0708 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:12.489167 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-893cb128-ce90-4a71-bb0e-2c55121d8f39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:12.489749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-893cb128-ce90-4a71-bb0e-2c55121d8f39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:12.495999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-893cb128-ce90-4a71-bb0e-2c55121d8f39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:12.496519 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-893cb128-ce90-4a71-bb0e-2c55121d8f39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:12.496994 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-893cb128-ce90-4a71-bb0e-2c55121d8f39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:12.497684 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-893cb128-ce90-4a71-bb0e-2c55121d8f39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:12.498255 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-893cb128-ce90-4a71-bb0e-2c55121d8f39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:12.498861 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-893cb128-ce90-4a71-bb0e-2c55121d8f39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:12.578757 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-893cb128-ce90-4a71-bb0e-2c55121d8f39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lazy-loading 'services' on Instance uuid e8ae93cb-bdd8-4d6a-85f5-52918c72f87b {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:13:12.649158 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-893cb128-ce90-4a71-bb0e-2c55121d8f39 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments/28acbadf-3187-49db-8896-e5bcd72a0708" status: 202 len: 0 microversion: 2.1 time: 0.164764 Aug 31 11:13:12.649707 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 519/966] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 11:13:12 2022] DELETE /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments/28acbadf-3187-49db-8896-e5bcd72a0708 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:13:13.831036 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-86ebb1dd-5197-434a-b206-c4157eaa71c9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:13.833400 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-86ebb1dd-5197-434a-b206-c4157eaa71c9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:13.839836 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86ebb1dd-5197-434a-b206-c4157eaa71c9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:13.840348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86ebb1dd-5197-434a-b206-c4157eaa71c9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:13.840787 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86ebb1dd-5197-434a-b206-c4157eaa71c9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:13.842147 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86ebb1dd-5197-434a-b206-c4157eaa71c9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:13.842803 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86ebb1dd-5197-434a-b206-c4157eaa71c9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:13.843234 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-86ebb1dd-5197-434a-b206-c4157eaa71c9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:13.871924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-86ebb1dd-5197-434a-b206-c4157eaa71c9 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044957 Aug 31 11:13:13.872512 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 448/967] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:13:13 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:13:13.987414 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-3807f140-99ba-4c48-af9c-48d2647a1786 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:13.989685 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-3807f140-99ba-4c48-af9c-48d2647a1786 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:13.995807 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3807f140-99ba-4c48-af9c-48d2647a1786 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:13.996319 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3807f140-99ba-4c48-af9c-48d2647a1786 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:13.996750 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3807f140-99ba-4c48-af9c-48d2647a1786 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:13.997431 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3807f140-99ba-4c48-af9c-48d2647a1786 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:13.997878 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3807f140-99ba-4c48-af9c-48d2647a1786 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:13.998298 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-3807f140-99ba-4c48-af9c-48d2647a1786 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:14.031978 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-3807f140-99ba-4c48-af9c-48d2647a1786 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049379 Aug 31 11:13:14.032736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 520/968] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 11:13:13 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:13:14.093421 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3598ac11-8742-4490-90c0-3478143535d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:14.093928 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3598ac11-8742-4490-90c0-3478143535d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:14.099791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3598ac11-8742-4490-90c0-3478143535d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:14.100318 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3598ac11-8742-4490-90c0-3478143535d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:14.100758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3598ac11-8742-4490-90c0-3478143535d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:14.101451 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3598ac11-8742-4490-90c0-3478143535d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:14.101909 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3598ac11-8742-4490-90c0-3478143535d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:14.102335 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3598ac11-8742-4490-90c0-3478143535d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:14.128437 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3598ac11-8742-4490-90c0-3478143535d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Going to try to terminate instance {{(pid=120655) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:13:14.203610 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3598ac11-8742-4490-90c0-3478143535d8 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 204 len: 0 microversion: 2.1 time: 0.114410 Aug 31 11:13:14.204334 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 449/969] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:13:14 2022] DELETE /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:13:14.213031 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-168c28f1-69c8-4d5f-b31f-25b263c5ded2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:14.213662 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-168c28f1-69c8-4d5f-b31f-25b263c5ded2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:14.219588 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-168c28f1-69c8-4d5f-b31f-25b263c5ded2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:14.220131 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-168c28f1-69c8-4d5f-b31f-25b263c5ded2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:14.220572 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-168c28f1-69c8-4d5f-b31f-25b263c5ded2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:14.221242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-168c28f1-69c8-4d5f-b31f-25b263c5ded2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:14.221695 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-168c28f1-69c8-4d5f-b31f-25b263c5ded2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:14.222122 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-168c28f1-69c8-4d5f-b31f-25b263c5ded2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:14.364476 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-168c28f1-69c8-4d5f-b31f-25b263c5ded2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:13:14.372050 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-168c28f1-69c8-4d5f-b31f-25b263c5ded2 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1672 microversion: 2.1 time: 0.163195 Aug 31 11:13:14.372609 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 521/970] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:14 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:13:15.394346 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b0780698-46c9-4c7c-9a53-a3442c2d843e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:15.395047 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b0780698-46c9-4c7c-9a53-a3442c2d843e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:15.401382 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b0780698-46c9-4c7c-9a53-a3442c2d843e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:15.401873 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b0780698-46c9-4c7c-9a53-a3442c2d843e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:15.402310 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b0780698-46c9-4c7c-9a53-a3442c2d843e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:15.403044 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b0780698-46c9-4c7c-9a53-a3442c2d843e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:15.403719 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b0780698-46c9-4c7c-9a53-a3442c2d843e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:15.404851 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b0780698-46c9-4c7c-9a53-a3442c2d843e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:15.543142 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b0780698-46c9-4c7c-9a53-a3442c2d843e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:13:15.551348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b0780698-46c9-4c7c-9a53-a3442c2d843e tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1672 microversion: 2.1 time: 0.161230 Aug 31 11:13:15.551914 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 450/971] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:15 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:13:16.572899 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-c2015f8e-efeb-4b4d-a671-3f5598b13240 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:16.573532 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-c2015f8e-efeb-4b4d-a671-3f5598b13240 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:16.580613 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c2015f8e-efeb-4b4d-a671-3f5598b13240 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:16.581308 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c2015f8e-efeb-4b4d-a671-3f5598b13240 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:16.581521 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c2015f8e-efeb-4b4d-a671-3f5598b13240 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:16.582204 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c2015f8e-efeb-4b4d-a671-3f5598b13240 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:16.582646 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c2015f8e-efeb-4b4d-a671-3f5598b13240 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:16.583062 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-c2015f8e-efeb-4b4d-a671-3f5598b13240 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:16.710318 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-c2015f8e-efeb-4b4d-a671-3f5598b13240 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:13:16.718123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-c2015f8e-efeb-4b4d-a671-3f5598b13240 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1672 microversion: 2.1 time: 0.149125 Aug 31 11:13:16.718692 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 522/972] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:16 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:13:17.739166 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-809f4bdb-0a04-4787-aefa-f63b3c589017 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:17.739770 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-809f4bdb-0a04-4787-aefa-f63b3c589017 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:17.746031 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-809f4bdb-0a04-4787-aefa-f63b3c589017 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:17.746513 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-809f4bdb-0a04-4787-aefa-f63b3c589017 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:17.746942 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-809f4bdb-0a04-4787-aefa-f63b3c589017 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:17.747658 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-809f4bdb-0a04-4787-aefa-f63b3c589017 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:17.748219 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-809f4bdb-0a04-4787-aefa-f63b3c589017 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:17.748640 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-809f4bdb-0a04-4787-aefa-f63b3c589017 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:17.876657 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-809f4bdb-0a04-4787-aefa-f63b3c589017 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:13:17.880144 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:17.885174 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-809f4bdb-0a04-4787-aefa-f63b3c589017 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1672 microversion: 2.1 time: 0.149851 Aug 31 11:13:17.885811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 451/973] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:17 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:13:18.908683 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1756435c-84a5-4ae3-9224-67bc227ef402 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:18.909287 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-1756435c-84a5-4ae3-9224-67bc227ef402 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:18.915346 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1756435c-84a5-4ae3-9224-67bc227ef402 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:18.915821 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1756435c-84a5-4ae3-9224-67bc227ef402 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:18.916277 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1756435c-84a5-4ae3-9224-67bc227ef402 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:18.916998 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1756435c-84a5-4ae3-9224-67bc227ef402 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:18.917443 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1756435c-84a5-4ae3-9224-67bc227ef402 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:18.917860 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-1756435c-84a5-4ae3-9224-67bc227ef402 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:18.999982 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-1756435c-84a5-4ae3-9224-67bc227ef402 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:13:19.009495 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1756435c-84a5-4ae3-9224-67bc227ef402 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1605 microversion: 2.1 time: 0.106407 Aug 31 11:13:19.010736 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 523/974] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:18 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1605 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:13:19.179619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-b3dce768-4c38-44a9-993f-bd1272948525 req-9d0a4ce3-fbf3-4acb-985c-7dbddf06d59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ae93cb-bdd8-4d6a-85f5-52918c72f87b", "name": "network-vif-deleted", "tag": "2f72082c-c379-4dfa-8614-d7a320906f23"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:13:19.201267 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-b3dce768-4c38-44a9-993f-bd1272948525 req-9d0a4ce3-fbf3-4acb-985c-7dbddf06d59e service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:19.201753 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-b3dce768-4c38-44a9-993f-bd1272948525 req-9d0a4ce3-fbf3-4acb-985c-7dbddf06d59e service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:19.202184 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-b3dce768-4c38-44a9-993f-bd1272948525 req-9d0a4ce3-fbf3-4acb-985c-7dbddf06d59e service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:19.216351 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-b3dce768-4c38-44a9-993f-bd1272948525 req-9d0a4ce3-fbf3-4acb-985c-7dbddf06d59e service nova] Creating event network-vif-deleted:2f72082c-c379-4dfa-8614-d7a320906f23 for instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b on hv-cinder-85535 Aug 31 11:13:19.222778 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-b3dce768-4c38-44a9-993f-bd1272948525 req-9d0a4ce3-fbf3-4acb-985c-7dbddf06d59e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047023 Aug 31 11:13:19.224142 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 452/975] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:20.036791 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:20.038064 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:20.064670 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:20.080118 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:20.080999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:20.084286 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:20.094275 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:20.097812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:20.101339 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:20.133715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:20.167750 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:20.168505 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:20.169157 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:20.169854 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lazy-loading 'fault' on Instance uuid e8ae93cb-bdd8-4d6a-85f5-52918c72f87b {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:13:20.230909 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d937b8a6c842819458b6e3c23f80fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b397afc10243bc9b93548873add6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:13:20.245550 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fa128fd5-ce64-4baf-91db-6aaa2c345d59 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 200 len: 1327 microversion: 2.1 time: 0.216522 Aug 31 11:13:20.246591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 524/976] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:20 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 1327 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:13:21.269226 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b81a93c1-b496-42cc-81fa-7297eb2e0c65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:21.271240 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b81a93c1-b496-42cc-81fa-7297eb2e0c65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:21.283319 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:21.288589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b81a93c1-b496-42cc-81fa-7297eb2e0c65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:21.290159 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b81a93c1-b496-42cc-81fa-7297eb2e0c65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:21.291181 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b81a93c1-b496-42cc-81fa-7297eb2e0c65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:21.292359 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b81a93c1-b496-42cc-81fa-7297eb2e0c65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:21.292923 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b81a93c1-b496-42cc-81fa-7297eb2e0c65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:21.293344 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b81a93c1-b496-42cc-81fa-7297eb2e0c65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:21.316056 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-b81a93c1-b496-42cc-81fa-7297eb2e0c65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] HTTP exception thrown: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b81a93c1-b496-42cc-81fa-7297eb2e0c65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Request method failure captured: Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b HTTP/1.1 Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0Dc1o31b2k1pptqFe_qjwnSjSeAdPSEIVCMs4gvjDXBQRmJgV8S57u1XRfg78SoBQ7nlkGN12g2GL_BovwAqcUS5FLXtLiOn2i7jOdRqZDXXEdOClIn1KUNu78q1J2z4Np5O4vwRYD2t-NBegtkrAaxDGNSmhOctQIcvai94Ziw8k8 Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 00b397afc10243bc9b93548873add6ef Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:13:21.317733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:13:21.319145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00b397afc10243bc9b93548873add6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00b397afc10243bc9b93548873add6ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00b397afc10243bc9b93548873add6ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00b397afc10243bc9b93548873add6ef"}]}] Aug 31 11:13:21.319145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:21.319145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 00b397afc10243bc9b93548873add6ef Aug 31 11:13:21.319145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:21.319145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeTestJSON-1324231620-project Aug 31 11:13:21.319145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:13:21.319145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:13:21.319145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 81d937b8a6c842819458b6e3c23f80fa Aug 31 11:13:21.319145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeTestJSON-1324231620-project Aug 31 11:13:21.319145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:13:21.319145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:21.319145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': 'e8ae93cb-bdd8-4d6a-85f5-52918c72f87b'} Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:13:21.323280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:21.325105 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:21.327450 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b81a93c1-b496-42cc-81fa-7297eb2e0c65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Returning 404 to user: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:13:21.327450 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b81a93c1-b496-42cc-81fa-7297eb2e0c65 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 404 len: 111 microversion: 2.1 time: 0.055412 Aug 31 11:13:21.327450 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 453/977] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:21 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:13:21.337477 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-1edca14f-f22f-462c-9214-75521171be8a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '.version_select at 0x7f732d32a700>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:21.366622 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-1edca14f-f22f-462c-9214-75521171be8a tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998678902" status: 202 len: 0 microversion: 2.1 time: 0.033264 Aug 31 11:13:21.371726 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 525/978] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 31 11:13:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998678902 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:13:21.516591 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-c2396f7a-3fa2-4ed4-b09f-36f690807bb8 req-5a953862-24af-431c-8901-b563dee05bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2a8d50-fa16-40f4-9760-25603efd4d6d", "tag": "e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:13:21.518332 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6a970722-43a2-4b82-9e85-90258fb184ce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:21.520311 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6a970722-43a2-4b82-9e85-90258fb184ce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:21.535898 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6a970722-43a2-4b82-9e85-90258fb184ce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:21.536412 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6a970722-43a2-4b82-9e85-90258fb184ce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:21.536841 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6a970722-43a2-4b82-9e85-90258fb184ce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:21.539039 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6a970722-43a2-4b82-9e85-90258fb184ce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:21.539495 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6a970722-43a2-4b82-9e85-90258fb184ce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:21.541781 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-c2396f7a-3fa2-4ed4-b09f-36f690807bb8 req-5a953862-24af-431c-8901-b563dee05bff service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:21.542453 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-c2396f7a-3fa2-4ed4-b09f-36f690807bb8 req-5a953862-24af-431c-8901-b563dee05bff service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:21.542697 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6a970722-43a2-4b82-9e85-90258fb184ce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:21.545186 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-c2396f7a-3fa2-4ed4-b09f-36f690807bb8 req-5a953862-24af-431c-8901-b563dee05bff service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:21.574195 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-c2396f7a-3fa2-4ed4-b09f-36f690807bb8 req-5a953862-24af-431c-8901-b563dee05bff service nova] Creating event network-changed:e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13 for instance dd2a8d50-fa16-40f4-9760-25603efd4d6d on hv-cinder-85535 Aug 31 11:13:21.586943 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-c2396f7a-3fa2-4ed4-b09f-36f690807bb8 req-5a953862-24af-431c-8901-b563dee05bff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078634 Aug 31 11:13:21.589968 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 526/979] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:21.601277 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6a970722-43a2-4b82-9e85-90258fb184ce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Going to try to terminate instance {{(pid=120655) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:13:21.742384 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6a970722-43a2-4b82-9e85-90258fb184ce tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 204 len: 0 microversion: 2.1 time: 0.236051 Aug 31 11:13:21.743927 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 454/980] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:13:21 2022] DELETE /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:13:21.755159 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b643dd3e-285f-4f58-bb3e-2b791ae8dc77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:21.756922 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b643dd3e-285f-4f58-bb3e-2b791ae8dc77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:21.766353 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b643dd3e-285f-4f58-bb3e-2b791ae8dc77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:21.767219 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b643dd3e-285f-4f58-bb3e-2b791ae8dc77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:21.767866 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b643dd3e-285f-4f58-bb3e-2b791ae8dc77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:21.768934 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b643dd3e-285f-4f58-bb3e-2b791ae8dc77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:21.769615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b643dd3e-285f-4f58-bb3e-2b791ae8dc77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:21.770240 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b643dd3e-285f-4f58-bb3e-2b791ae8dc77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:22.024023 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b643dd3e-285f-4f58-bb3e-2b791ae8dc77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:13:22.032682 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b643dd3e-285f-4f58-bb3e-2b791ae8dc77 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.282403 Aug 31 11:13:22.033265 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 527/981] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:21 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:13:23.055529 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4ead0010-3c45-4cee-a09b-d19c6fddee9a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:23.056365 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-4ead0010-3c45-4cee-a09b-d19c6fddee9a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:23.063434 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4ead0010-3c45-4cee-a09b-d19c6fddee9a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:23.063921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4ead0010-3c45-4cee-a09b-d19c6fddee9a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:23.064374 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4ead0010-3c45-4cee-a09b-d19c6fddee9a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:23.065071 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4ead0010-3c45-4cee-a09b-d19c6fddee9a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:23.065515 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4ead0010-3c45-4cee-a09b-d19c6fddee9a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:23.065929 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-4ead0010-3c45-4cee-a09b-d19c6fddee9a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:23.369737 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-4ead0010-3c45-4cee-a09b-d19c6fddee9a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:13:23.381351 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4ead0010-3c45-4cee-a09b-d19c6fddee9a tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1568 microversion: 2.1 time: 0.330032 Aug 31 11:13:23.382220 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 455/982] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:23 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1568 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:13:24.188494 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-1a914bc3-7716-4c7b-b347-3027b3311c14 req-34e745e9-e867-4d08-a907-b1b39b9f9b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2a8d50-fa16-40f4-9760-25603efd4d6d", "name": "network-vif-deleted", "tag": "e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:13:24.203483 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-1a914bc3-7716-4c7b-b347-3027b3311c14 req-34e745e9-e867-4d08-a907-b1b39b9f9b35 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:24.204320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-1a914bc3-7716-4c7b-b347-3027b3311c14 req-34e745e9-e867-4d08-a907-b1b39b9f9b35 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:24.205075 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-1a914bc3-7716-4c7b-b347-3027b3311c14 req-34e745e9-e867-4d08-a907-b1b39b9f9b35 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:24.219877 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-1a914bc3-7716-4c7b-b347-3027b3311c14 req-34e745e9-e867-4d08-a907-b1b39b9f9b35 service nova] Creating event network-vif-deleted:e293e6b9-f62a-4ff5-be3a-3a4fcaffcf13 for instance dd2a8d50-fa16-40f4-9760-25603efd4d6d on hv-cinder-85535 Aug 31 11:13:24.225527 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-1a914bc3-7716-4c7b-b347-3027b3311c14 req-34e745e9-e867-4d08-a907-b1b39b9f9b35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042270 Aug 31 11:13:24.226206 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 528/983] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:13:24.403988 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d41474f2-cea4-4caf-8820-4e6e96b82127 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:24.404614 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d41474f2-cea4-4caf-8820-4e6e96b82127 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:24.411663 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d41474f2-cea4-4caf-8820-4e6e96b82127 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:24.412261 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d41474f2-cea4-4caf-8820-4e6e96b82127 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:24.412999 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d41474f2-cea4-4caf-8820-4e6e96b82127 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:24.413805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d41474f2-cea4-4caf-8820-4e6e96b82127 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:24.414323 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d41474f2-cea4-4caf-8820-4e6e96b82127 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:24.414957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d41474f2-cea4-4caf-8820-4e6e96b82127 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:24.487110 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d41474f2-cea4-4caf-8820-4e6e96b82127 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c0e96bc0584d8b9be73ae920bbb055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42099ef23496441fab42f876b9e39efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:13:24.499619 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d41474f2-cea4-4caf-8820-4e6e96b82127 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 200 len: 1219 microversion: 2.1 time: 0.100404 Aug 31 11:13:24.503430 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 456/984] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:24 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:13:24.844862 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ac2bc4d1-d797-4ce6-8a7c-3846930b70ef tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:24.845522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ac2bc4d1-d797-4ce6-8a7c-3846930b70ef tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:24.851867 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac2bc4d1-d797-4ce6-8a7c-3846930b70ef tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:24.852733 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac2bc4d1-d797-4ce6-8a7c-3846930b70ef tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:24.853337 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac2bc4d1-d797-4ce6-8a7c-3846930b70ef tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:24.853992 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac2bc4d1-d797-4ce6-8a7c-3846930b70ef tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:24.854601 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac2bc4d1-d797-4ce6-8a7c-3846930b70ef tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:24.855187 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ac2bc4d1-d797-4ce6-8a7c-3846930b70ef tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:24.870617 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-ac2bc4d1-d797-4ce6-8a7c-3846930b70ef tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] HTTP exception thrown: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ac2bc4d1-d797-4ce6-8a7c-3846930b70ef tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Request method failure captured: Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: DELETE /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b HTTP/1.1 Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0Dc1o31b2k1pptqFe_qjwnSjSeAdPSEIVCMs4gvjDXBQRmJgV8S57u1XRfg78SoBQ7nlkGN12g2GL_BovwAqcUS5FLXtLiOn2i7jOdRqZDXXEdOClIn1KUNu78q1J2z4Np5O4vwRYD2t-NBegtkrAaxDGNSmhOctQIcvai94Ziw8k8 Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 00b397afc10243bc9b93548873add6ef Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:13:24.872296 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:13:24.873826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00b397afc10243bc9b93548873add6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00b397afc10243bc9b93548873add6ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00b397afc10243bc9b93548873add6ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00b397afc10243bc9b93548873add6ef"}]}] Aug 31 11:13:24.873826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:24.873826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 00b397afc10243bc9b93548873add6ef Aug 31 11:13:24.873826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:24.873826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-AttachVolumeTestJSON-1324231620-project Aug 31 11:13:24.873826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:13:24.873826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:13:24.873826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 81d937b8a6c842819458b6e3c23f80fa Aug 31 11:13:24.873826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-AttachVolumeTestJSON-1324231620-project Aug 31 11:13:24.873826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:13:24.873826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:24.873826 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': 'e8ae93cb-bdd8-4d6a-85f5-52918c72f87b'} Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:13:24.874702 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:24.876035 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:24.878893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ac2bc4d1-d797-4ce6-8a7c-3846930b70ef tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Returning 404 to user: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:13:24.878893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ac2bc4d1-d797-4ce6-8a7c-3846930b70ef tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 404 len: 111 microversion: 2.1 time: 0.035548 Aug 31 11:13:24.878893 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 529/985] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:13:24 2022] DELETE /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:13:24.882403 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-22f0242d-fc19-4f27-9ad5-0bd37c14eeab tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:24.883018 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-22f0242d-fc19-4f27-9ad5-0bd37c14eeab tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: e8ae93cb-bdd8-4d6a-85f5-52918c72f87b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:24.890524 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-22f0242d-fc19-4f27-9ad5-0bd37c14eeab tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:24.891015 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-22f0242d-fc19-4f27-9ad5-0bd37c14eeab tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:24.891551 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-22f0242d-fc19-4f27-9ad5-0bd37c14eeab tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:24.893581 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-22f0242d-fc19-4f27-9ad5-0bd37c14eeab tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:24.894075 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-22f0242d-fc19-4f27-9ad5-0bd37c14eeab tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:24.897095 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-22f0242d-fc19-4f27-9ad5-0bd37c14eeab tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:24.916921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-22f0242d-fc19-4f27-9ad5-0bd37c14eeab tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] HTTP exception thrown: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-22f0242d-fc19-4f27-9ad5-0bd37c14eeab tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Request method failure captured: Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b HTTP/1.1 Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0Dc1o31b2k1pptqFe_qjwnSjSeAdPSEIVCMs4gvjDXBQRmJgV8S57u1XRfg78SoBQ7nlkGN12g2GL_BovwAqcUS5FLXtLiOn2i7jOdRqZDXXEdOClIn1KUNu78q1J2z4Np5O4vwRYD2t-NBegtkrAaxDGNSmhOctQIcvai94Ziw8k8 Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 00b397afc10243bc9b93548873add6ef Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:13:24.918331 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:13:24.920648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00b397afc10243bc9b93548873add6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00b397afc10243bc9b93548873add6ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00b397afc10243bc9b93548873add6ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00b397afc10243bc9b93548873add6ef"}]}] Aug 31 11:13:24.920648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:24.920648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 00b397afc10243bc9b93548873add6ef Aug 31 11:13:24.920648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:24.920648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeTestJSON-1324231620-project Aug 31 11:13:24.920648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:13:24.920648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:13:24.920648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 81d937b8a6c842819458b6e3c23f80fa Aug 31 11:13:24.920648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeTestJSON-1324231620-project Aug 31 11:13:24.920648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:13:24.920648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:24.920648 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': 'e8ae93cb-bdd8-4d6a-85f5-52918c72f87b'} Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:13:24.921508 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. Aug 31 11:13:24.922797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:24.923921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-22f0242d-fc19-4f27-9ad5-0bd37c14eeab tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Returning 404 to user: Instance e8ae93cb-bdd8-4d6a-85f5-52918c72f87b could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:13:24.923921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-22f0242d-fc19-4f27-9ad5-0bd37c14eeab tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b" status: 404 len: 111 microversion: 2.1 time: 0.042120 Aug 31 11:13:24.923921 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 457/986] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:24 2022] GET /compute/v2.1/servers/e8ae93cb-bdd8-4d6a-85f5-52918c72f87b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:13:25.523137 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-81a47083-4c19-42f5-8db6-5037e2cba4d6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:25.524269 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-81a47083-4c19-42f5-8db6-5037e2cba4d6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] [instance: dd2a8d50-fa16-40f4-9760-25603efd4d6d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:25.532326 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-81a47083-4c19-42f5-8db6-5037e2cba4d6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:25.532955 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-81a47083-4c19-42f5-8db6-5037e2cba4d6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:25.533468 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-81a47083-4c19-42f5-8db6-5037e2cba4d6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:25.534320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-81a47083-4c19-42f5-8db6-5037e2cba4d6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:25.534973 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-81a47083-4c19-42f5-8db6-5037e2cba4d6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:25.535529 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-81a47083-4c19-42f5-8db6-5037e2cba4d6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:25.552064 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-81a47083-4c19-42f5-8db6-5037e2cba4d6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] HTTP exception thrown: Instance dd2a8d50-fa16-40f4-9760-25603efd4d6d could not be found. Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-81a47083-4c19-42f5-8db6-5037e2cba4d6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Request method failure captured: Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d HTTP/1.1 Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0Dr-EzwRR1uFIWhM6T4TIzBl0GxsouLqQimX10LW_LErcoPR7poD5mVLZ2fgGYUKA6NHa02Wobuxb5UK16ZcfgSU0W3U3hbwEkqSNfCbPgcmbh7g_gu-x3YYQ53AQyRKliENcPKTUAZDSEbbMz3KI2wSVzvyOdhQPsG6ZYbMs-_zw8 Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 42099ef23496441fab42f876b9e39efd Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-TestShelveInstance-2100822344 Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:13:25.553834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:13:25.557042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/42099ef23496441fab42f876b9e39efd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_42099ef23496441fab42f876b9e39efd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42099ef23496441fab42f876b9e39efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42099ef23496441fab42f876b9e39efd"}]}] Aug 31 11:13:25.557042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-TestShelveInstance-2100822344 Aug 31 11:13:25.557042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 42099ef23496441fab42f876b9e39efd Aug 31 11:13:25.557042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-TestShelveInstance-2100822344 Aug 31 11:13:25.557042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-TestShelveInstance-2100822344-project Aug 31 11:13:25.557042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:13:25.557042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:13:25.557042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: d8c0e96bc0584d8b9be73ae920bbb055 Aug 31 11:13:25.557042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-TestShelveInstance-2100822344-project Aug 31 11:13:25.557042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:13:25.557042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance dd2a8d50-fa16-40f4-9760-25603efd4d6d could not be found. Aug 31 11:13:25.557042 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': 'dd2a8d50-fa16-40f4-9760-25603efd4d6d'} Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd2a8d50-fa16-40f4-9760-25603efd4d6d could not be found. Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:13:25.558341 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd2a8d50-fa16-40f4-9760-25603efd4d6d could not be found. Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd2a8d50-fa16-40f4-9760-25603efd4d6d could not be found. Aug 31 11:13:25.560279 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:25.561531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-81a47083-4c19-42f5-8db6-5037e2cba4d6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Returning 404 to user: Instance dd2a8d50-fa16-40f4-9760-25603efd4d6d could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:13:25.561531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-81a47083-4c19-42f5-8db6-5037e2cba4d6 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d" status: 404 len: 111 microversion: 2.1 time: 0.037175 Aug 31 11:13:25.561531 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 530/987] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:25 2022] GET /compute/v2.1/servers/dd2a8d50-fa16-40f4-9760-25603efd4d6d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:13:25.727007 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-79946784-43b6-49bc-a25b-efb955a522a9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] Calling method '.version_select at 0x7f732d19fee0>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:25.752315 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-79946784-43b6-49bc-a25b-efb955a522a9 tempest-TestShelveInstance-2100822344 tempest-TestShelveInstance-2100822344-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1858534218" status: 202 len: 0 microversion: 2.1 time: 0.029440 Aug 31 11:13:25.753242 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 458/988] 10.222.0.20 () {58 vars in 1254 bytes} [Wed Aug 31 11:13:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1858534218 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:13:26.066641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-631a5385-48c1-4e18-8381-5ccf826b8f95 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:26.067243 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-631a5385-48c1-4e18-8381-5ccf826b8f95 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:26.074203 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-631a5385-48c1-4e18-8381-5ccf826b8f95 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:26.075036 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-631a5385-48c1-4e18-8381-5ccf826b8f95 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:26.075563 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-631a5385-48c1-4e18-8381-5ccf826b8f95 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:26.076401 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-631a5385-48c1-4e18-8381-5ccf826b8f95 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:26.077108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-631a5385-48c1-4e18-8381-5ccf826b8f95 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:26.077624 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-631a5385-48c1-4e18-8381-5ccf826b8f95 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:26.091669 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-631a5385-48c1-4e18-8381-5ccf826b8f95 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] HTTP exception thrown: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-631a5385-48c1-4e18-8381-5ccf826b8f95 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Request method failure captured: Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: DELETE /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 HTTP/1.1 Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0Dc1o31b2k1pptqFe_qjwnSjSeAdPSEIVCMs4gvjDXBQRmJgV8S57u1XRfg78SoBQ7nlkGN12g2GL_BovwAqcUS5FLXtLiOn2i7jOdRqZDXXEdOClIn1KUNu78q1J2z4Np5O4vwRYD2t-NBegtkrAaxDGNSmhOctQIcvai94Ziw8k8 Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: 00b397afc10243bc9b93548873add6ef Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:13:26.093377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:13:26.095047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00b397afc10243bc9b93548873add6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00b397afc10243bc9b93548873add6ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00b397afc10243bc9b93548873add6ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00b397afc10243bc9b93548873add6ef"}]}] Aug 31 11:13:26.095047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:26.095047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: 00b397afc10243bc9b93548873add6ef Aug 31 11:13:26.095047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:26.095047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-AttachVolumeTestJSON-1324231620-project Aug 31 11:13:26.095047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:13:26.095047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:13:26.095047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 81d937b8a6c842819458b6e3c23f80fa Aug 31 11:13:26.095047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-AttachVolumeTestJSON-1324231620-project Aug 31 11:13:26.095047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:13:26.095047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:13:26.095047 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': 'b50ff8cd-8095-43f9-9b25-30536f129ac3'} Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:13:26.096040 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:13:26.097471 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:26.098990 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-631a5385-48c1-4e18-8381-5ccf826b8f95 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Returning 404 to user: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:13:26.098990 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-631a5385-48c1-4e18-8381-5ccf826b8f95 tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 404 len: 111 microversion: 2.1 time: 0.032945 Aug 31 11:13:26.098990 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 531/989] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:13:26 2022] DELETE /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:13:26.105575 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ab55dfdd-b60e-4891-9444-b1ede5ac2f3d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:26.106928 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ab55dfdd-b60e-4891-9444-b1ede5ac2f3d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] [instance: b50ff8cd-8095-43f9-9b25-30536f129ac3] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:13:26.116666 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab55dfdd-b60e-4891-9444-b1ede5ac2f3d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:26.117172 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab55dfdd-b60e-4891-9444-b1ede5ac2f3d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:26.117598 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab55dfdd-b60e-4891-9444-b1ede5ac2f3d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:26.118384 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab55dfdd-b60e-4891-9444-b1ede5ac2f3d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:13:26.118843 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab55dfdd-b60e-4891-9444-b1ede5ac2f3d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:13:26.119310 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ab55dfdd-b60e-4891-9444-b1ede5ac2f3d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:13:26.134694 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-ab55dfdd-b60e-4891-9444-b1ede5ac2f3d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] HTTP exception thrown: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ab55dfdd-b60e-4891-9444-b1ede5ac2f3d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Request method failure captured: Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 HTTP/1.1 Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0Dc1o31b2k1pptqFe_qjwnSjSeAdPSEIVCMs4gvjDXBQRmJgV8S57u1XRfg78SoBQ7nlkGN12g2GL_BovwAqcUS5FLXtLiOn2i7jOdRqZDXXEdOClIn1KUNu78q1J2z4Np5O4vwRYD2t-NBegtkrAaxDGNSmhOctQIcvai94Ziw8k8 Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 00b397afc10243bc9b93548873add6ef Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:13:26.136579 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:13:26.138411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00b397afc10243bc9b93548873add6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00b397afc10243bc9b93548873add6ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00b397afc10243bc9b93548873add6ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00b397afc10243bc9b93548873add6ef"}]}] Aug 31 11:13:26.138411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:26.138411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 00b397afc10243bc9b93548873add6ef Aug 31 11:13:26.138411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1324231620 Aug 31 11:13:26.138411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-AttachVolumeTestJSON-1324231620-project Aug 31 11:13:26.138411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:13:26.138411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:13:26.138411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 81d937b8a6c842819458b6e3c23f80fa Aug 31 11:13:26.138411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-AttachVolumeTestJSON-1324231620-project Aug 31 11:13:26.138411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:13:26.138411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:13:26.138411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': 'b50ff8cd-8095-43f9-9b25-30536f129ac3'} Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:13:26.140566 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. Aug 31 11:13:26.142982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:13:26.144622 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ab55dfdd-b60e-4891-9444-b1ede5ac2f3d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] Returning 404 to user: Instance b50ff8cd-8095-43f9-9b25-30536f129ac3 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:13:26.144622 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ab55dfdd-b60e-4891-9444-b1ede5ac2f3d tempest-AttachVolumeTestJSON-1324231620 tempest-AttachVolumeTestJSON-1324231620-project] 10.222.0.20 "GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3" status: 404 len: 111 microversion: 2.1 time: 0.037296 Aug 31 11:13:26.144622 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 459/990] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:13:26 2022] GET /compute/v2.1/servers/b50ff8cd-8095-43f9-9b25-30536f129ac3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:13:33.163688 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e4570479-2b8b-4014-bffb-e9a772a3d244 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] Action: 'create', calling method: .version_select at 0x7f732d3fd790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2121755594", "metadata": {"Type": "work"}}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:13:33.671499 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e4570479-2b8b-4014-bffb-e9a772a3d244 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.732910 Aug 31 11:13:33.672572 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 532/991] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 31 11:13:32 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 735 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 11:13:33.689252 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-4524c431-5aaa-4efb-8233-6bc8b2317092 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] Calling method '.version_select at 0x7f732d65d0d0>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:33.780961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-4524c431-5aaa-4efb-8233-6bc8b2317092 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62" status: 200 len: 353 microversion: 2.1 time: 0.096303 Aug 31 11:13:33.782408 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 460/992] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:13:33 2022] GET /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:34.800362 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9410bf69-5b16-401f-8f2c-f2e2fdb7f2f8 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] Calling method '.version_select at 0x7f732d3680d0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:34.877793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9410bf69-5b16-401f-8f2c-f2e2fdb7f2f8 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62" status: 200 len: 354 microversion: 2.1 time: 0.084366 Aug 31 11:13:34.884318 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 533/993] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:13:34 2022] GET /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:34.891892 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1fac83fd-4cbb-4f27-8806-8eb22c9f6986 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] Calling method '.version_select at 0x7f732d2c2430>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:34.972872 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-1fac83fd-4cbb-4f27-8806-8eb22c9f6986 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62" status: 200 len: 354 microversion: 2.1 time: 0.085453 Aug 31 11:13:34.973814 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 461/994] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:13:34 2022] GET /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:34.992582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-adeee09c-77de-4cf6-8672-bb4d636e3d74 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] Calling method '.version_select at 0x7f732d3fdee0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:35.070220 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-adeee09c-77de-4cf6-8672-bb4d636e3d74 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62" status: 202 len: 0 microversion: 2.1 time: 0.081915 Aug 31 11:13:35.070785 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 534/995] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 11:13:34 2022] DELETE /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:13:35.083378 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3756d8d1-d65e-4358-97ed-4b1063923230 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] Calling method '.version_select at 0x7f732d19f4c0>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:35.178174 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3756d8d1-d65e-4358-97ed-4b1063923230 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62" status: 200 len: 353 microversion: 2.1 time: 0.102395 Aug 31 11:13:35.179160 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 462/996] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:13:35 2022] GET /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:13:36.195902 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4361ffe8-b618-4c9c-b465-930a2b3f8786 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] Calling method '.version_select at 0x7f732d220ca0>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:13:36.204208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:36.204692 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=23 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:36.244000 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-4361ffe8-b618-4c9c-b465-930a2b3f8786 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] HTTP exception thrown: Volume 84d2e612-73a9-4113-8836-d06666225e62 could not be found. Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4361ffe8-b618-4c9c-b465-930a2b3f8786 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] Request method failure captured: Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62 HTTP/1.1 Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0JcuKvERrFNltAlfpnkogFf429gnXb75LQDWfcnqDjdUouVTzuUZbka7jD81xgck9Z8q6Iygw0cRij1xmBBvrrJWhgXUvzu9fO8kLUdMgYFnuCKArc43zQGrBQwxfh8RMk6F_BSDdOkLGMxc5nBDYZ78TRMr0I3q580zAQ3Z7B1DO8 Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: a1cc280f321b4896a9af2d59312f3fbe Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-VolumesGetTestJSON-1982262359 Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:13:36.246323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a1cc280f321b4896a9af2d59312f3fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a1cc280f321b4896a9af2d59312f3fbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a1cc280f321b4896a9af2d59312f3fbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a1cc280f321b4896a9af2d59312f3fbe"}]}] Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-VolumesGetTestJSON-1982262359 Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: a1cc280f321b4896a9af2d59312f3fbe Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-VolumesGetTestJSON-1982262359 Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-VolumesGetTestJSON-1982262359-project Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 3a0be5ca18164c849baa1760fb297479 Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-VolumesGetTestJSON-1982262359-project Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Volume 84d2e612-73a9-4113-8836-d06666225e62 could not be found. Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '84d2e612-73a9-4113-8836-d06666225e62'} Aug 31 11:13:36.248301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84d2e612-73a9-4113-8836-d06666225e62 could not be found. (HTTP 404) (Request-ID: req-01f4e01c-793e-4991-a594-d9eaf31e41a9) Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:36.249208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:13:36.250451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84d2e612-73a9-4113-8836-d06666225e62 could not be found. Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 11:13:36.252027 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:13:36.253635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84d2e612-73a9-4113-8836-d06666225e62 could not be found. Aug 31 11:13:36.253635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:36.253635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:13:36.253635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:36.253635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:13:36.253635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:13:36.253635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:13:36.253635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:13:36.253635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:13:36.253635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84d2e612-73a9-4113-8836-d06666225e62 could not be found. Aug 31 11:13:36.253635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:13:36.256971 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4361ffe8-b618-4c9c-b465-930a2b3f8786 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] Returning 404 to user: Volume 84d2e612-73a9-4113-8836-d06666225e62 could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:13:36.256971 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4361ffe8-b618-4c9c-b465-930a2b3f8786 tempest-VolumesGetTestJSON-1982262359 tempest-VolumesGetTestJSON-1982262359-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62" status: 404 len: 109 microversion: 2.1 time: 0.064300 Aug 31 11:13:36.256971 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 535/997] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 11:13:36 2022] GET /compute/v2.1/os-volumes/84d2e612-73a9-4113-8836-d06666225e62 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:14:09.537899 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:09.538638 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:09.542924 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-36026f19-5f87-4c6c-b33e-e7072c91f582 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:09.543421 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-36026f19-5f87-4c6c-b33e-e7072c91f582 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:09.550767 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-36026f19-5f87-4c6c-b33e-e7072c91f582 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:09.551242 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-36026f19-5f87-4c6c-b33e-e7072c91f582 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:09.551671 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-36026f19-5f87-4c6c-b33e-e7072c91f582 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:09.552387 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-36026f19-5f87-4c6c-b33e-e7072c91f582 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:09.552832 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-36026f19-5f87-4c6c-b33e-e7072c91f582 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:09.553248 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-36026f19-5f87-4c6c-b33e-e7072c91f582 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:09.579584 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-36026f19-5f87-4c6c-b33e-e7072c91f582 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Going to try to terminate instance {{(pid=120655) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:14:09.655390 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-36026f19-5f87-4c6c-b33e-e7072c91f582 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 204 len: 0 microversion: 2.1 time: 0.118695 Aug 31 11:14:09.656163 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 463/998] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:14:09 2022] DELETE /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:14:09.668522 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4a5cabcd-fb41-408a-b70d-dbe144418178 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:09.669115 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4a5cabcd-fb41-408a-b70d-dbe144418178 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:09.674999 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4a5cabcd-fb41-408a-b70d-dbe144418178 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:09.675473 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4a5cabcd-fb41-408a-b70d-dbe144418178 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:09.675903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4a5cabcd-fb41-408a-b70d-dbe144418178 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:09.676650 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4a5cabcd-fb41-408a-b70d-dbe144418178 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:09.677098 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4a5cabcd-fb41-408a-b70d-dbe144418178 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:09.677518 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4a5cabcd-fb41-408a-b70d-dbe144418178 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:09.810576 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4a5cabcd-fb41-408a-b70d-dbe144418178 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:09.818560 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4a5cabcd-fb41-408a-b70d-dbe144418178 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1576 microversion: 2.1 time: 0.158241 Aug 31 11:14:09.819120 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 536/999] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:09 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:10.841234 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-03795f36-feb9-4657-9b33-9848101e3e9b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:10.841941 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-03795f36-feb9-4657-9b33-9848101e3e9b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:10.848388 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-03795f36-feb9-4657-9b33-9848101e3e9b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:10.848874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-03795f36-feb9-4657-9b33-9848101e3e9b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:10.849315 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-03795f36-feb9-4657-9b33-9848101e3e9b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:10.850038 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-03795f36-feb9-4657-9b33-9848101e3e9b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:10.850490 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-03795f36-feb9-4657-9b33-9848101e3e9b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:10.850917 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-03795f36-feb9-4657-9b33-9848101e3e9b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:10.985332 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-03795f36-feb9-4657-9b33-9848101e3e9b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:10.992949 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-03795f36-feb9-4657-9b33-9848101e3e9b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1576 microversion: 2.1 time: 0.156229 Aug 31 11:14:10.993510 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 464/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:10 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:12.014642 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-bc67bf6b-1b67-43ab-a70a-939f21abe79d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:12.015292 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-bc67bf6b-1b67-43ab-a70a-939f21abe79d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:12.021354 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc67bf6b-1b67-43ab-a70a-939f21abe79d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:12.021828 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc67bf6b-1b67-43ab-a70a-939f21abe79d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:12.022260 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc67bf6b-1b67-43ab-a70a-939f21abe79d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:12.022940 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc67bf6b-1b67-43ab-a70a-939f21abe79d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:12.023385 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc67bf6b-1b67-43ab-a70a-939f21abe79d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:12.023799 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-bc67bf6b-1b67-43ab-a70a-939f21abe79d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:12.161224 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-bc67bf6b-1b67-43ab-a70a-939f21abe79d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:12.169935 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-bc67bf6b-1b67-43ab-a70a-939f21abe79d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1576 microversion: 2.1 time: 0.159444 Aug 31 11:14:12.170499 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 537/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:12 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:13.190995 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a88a4b86-e7e9-4f5f-abd4-311a86f2a799 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:13.191853 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a88a4b86-e7e9-4f5f-abd4-311a86f2a799 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:13.199957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a88a4b86-e7e9-4f5f-abd4-311a86f2a799 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:13.200464 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a88a4b86-e7e9-4f5f-abd4-311a86f2a799 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:13.200898 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a88a4b86-e7e9-4f5f-abd4-311a86f2a799 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:13.201733 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a88a4b86-e7e9-4f5f-abd4-311a86f2a799 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:13.202397 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a88a4b86-e7e9-4f5f-abd4-311a86f2a799 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:13.203153 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a88a4b86-e7e9-4f5f-abd4-311a86f2a799 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:13.341134 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a88a4b86-e7e9-4f5f-abd4-311a86f2a799 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:13.348893 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a88a4b86-e7e9-4f5f-abd4-311a86f2a799 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1576 microversion: 2.1 time: 0.161954 Aug 31 11:14:13.349460 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 465/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:13 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:14.370021 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4abcc609-aa56-41ab-b088-797bc5deadec tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:14.370738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4abcc609-aa56-41ab-b088-797bc5deadec tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:14.376889 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4abcc609-aa56-41ab-b088-797bc5deadec tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:14.377464 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4abcc609-aa56-41ab-b088-797bc5deadec tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:14.377912 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4abcc609-aa56-41ab-b088-797bc5deadec tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:14.378833 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4abcc609-aa56-41ab-b088-797bc5deadec tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:14.379423 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4abcc609-aa56-41ab-b088-797bc5deadec tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:14.379856 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4abcc609-aa56-41ab-b088-797bc5deadec tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:14.456119 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4abcc609-aa56-41ab-b088-797bc5deadec tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:14.464681 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4abcc609-aa56-41ab-b088-797bc5deadec tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 200 len: 1509 microversion: 2.1 time: 0.098042 Aug 31 11:14:14.465703 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 538/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:14 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 1509 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:14.566118 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-6625b959-ce48-47ef-a9e7-4ade4e7d3d0b req-5af8dc7c-240b-405e-9bd0-767d2e9e503c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a86bd6-faab-4980-ac6b-19ecb1d2bf5b", "name": "network-vif-deleted", "tag": "529be65a-b8c1-4b8d-b9bf-ef0a72d238ae"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:14:14.586026 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-6625b959-ce48-47ef-a9e7-4ade4e7d3d0b req-5af8dc7c-240b-405e-9bd0-767d2e9e503c service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:14.586528 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-6625b959-ce48-47ef-a9e7-4ade4e7d3d0b req-5af8dc7c-240b-405e-9bd0-767d2e9e503c service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:14.586947 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-6625b959-ce48-47ef-a9e7-4ade4e7d3d0b req-5af8dc7c-240b-405e-9bd0-767d2e9e503c service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:14.603246 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-6625b959-ce48-47ef-a9e7-4ade4e7d3d0b req-5af8dc7c-240b-405e-9bd0-767d2e9e503c service nova] Creating event network-vif-deleted:529be65a-b8c1-4b8d-b9bf-ef0a72d238ae for instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b on hv-cinder-85535 Aug 31 11:14:14.608811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-6625b959-ce48-47ef-a9e7-4ade4e7d3d0b req-5af8dc7c-240b-405e-9bd0-767d2e9e503c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048287 Aug 31 11:14:14.609991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 466/1004] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:14:15.486834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d8507e6b-4284-44bf-bd5d-4e10385a44e9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:15.487507 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d8507e6b-4284-44bf-bd5d-4e10385a44e9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:15.494242 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8507e6b-4284-44bf-bd5d-4e10385a44e9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:15.494723 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8507e6b-4284-44bf-bd5d-4e10385a44e9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:15.495173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8507e6b-4284-44bf-bd5d-4e10385a44e9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:15.496704 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8507e6b-4284-44bf-bd5d-4e10385a44e9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:15.497520 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8507e6b-4284-44bf-bd5d-4e10385a44e9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:15.497701 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d8507e6b-4284-44bf-bd5d-4e10385a44e9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:15.512332 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-d8507e6b-4284-44bf-bd5d-4e10385a44e9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] HTTP exception thrown: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d8507e6b-4284-44bf-bd5d-4e10385a44e9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Request method failure captured: Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b HTTP/1.1 Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0G_5CnX0bgu49qBKEATrPjG5ij1O-g_F-tJeS3zcQuveUNLmpeNedxKK-hb2CtQauSFh7J_yZUA84PLFjvGSp83HfmZq41rhTg89kUz9RglDEWJhTTgATyWoUcj7nI28YGWmyXan6KrHqcZ7FwaN-TfvwTMYRnoebG29g96CCD25E0 Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: da5b36cb688f49e1bf1cf75a108858fa Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:14:15.513874 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:14:15.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da5b36cb688f49e1bf1cf75a108858fa"}]}] Aug 31 11:14:15.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:14:15.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: da5b36cb688f49e1bf1cf75a108858fa Aug 31 11:14:15.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:14:15.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-TestVolumeBootPattern-1688397389-project Aug 31 11:14:15.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:14:15.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:14:15.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 16696c34de254f3babf538c879f2ce49 Aug 31 11:14:15.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-TestVolumeBootPattern-1688397389-project Aug 31 11:14:15.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:14:15.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:14:15.515398 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '73a86bd6-faab-4980-ac6b-19ecb1d2bf5b'} Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:14:15.516485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:14:15.518003 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:14:15.519405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d8507e6b-4284-44bf-bd5d-4e10385a44e9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Returning 404 to user: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:14:15.519405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d8507e6b-4284-44bf-bd5d-4e10385a44e9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 404 len: 111 microversion: 2.1 time: 0.032470 Aug 31 11:14:15.519405 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 539/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:15 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:14:15.639465 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-645982527", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1158123877", "security_groups": [{"name": "tempest-secgroup-smoke-320297181"}], "block_device_mapping_v2": [{"uuid": "48725585-4895-480a-878e-561a4cec0194", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fdfc4a33-02c2-4205-b00d-34df8bb675d5"}]}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:14:15.787577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.network.neutron [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] validate_networks() for [('fdfc4a33-02c2-4205-b00d-34df8bb675d5', None, None, None, None, None)] {{(pid=120655) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:14:16.172556 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Flavor limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:14:16.172977 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Image limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:14:16.173458 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Flavor pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:14:16.173838 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Image pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:14:16.174249 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:14:16.183867 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:16.184379 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:16.185004 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:16.185734 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:16.186190 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:16.186621 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:16.203790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Getting quotas for project da5b36cb688f49e1bf1cf75a108858fa. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:14:16.207712 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Getting quotas for user 16696c34de254f3babf538c879f2ce49 and project da5b36cb688f49e1bf1cf75a108858fa. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:14:16.276964 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Going to run 1 instances... {{(pid=120655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:14:16.279209 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48725585-4895-480a-878e-561a4cec0194',volume_size=None,volume_type=None)] {{(pid=120655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:14:16.418851 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [917bba94-6162-43be-8625-ca5f6c65655b] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 11:14:17.427019 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO oslo.messaging._drivers.impl_rabbit [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [917bba94-6162-43be-8625-ca5f6c65655b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40128. Aug 31 11:14:17.431381 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-8e76abfe-8325-4a20-a9bb-8eec34840f94 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.797603 Aug 31 11:14:17.432083 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 467/1006] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:14:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:14:17.445025 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-54d32f77-6551-4047-81fe-5e02e7feed81 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:17.445633 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-54d32f77-6551-4047-81fe-5e02e7feed81 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:17.503051 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-54d32f77-6551-4047-81fe-5e02e7feed81 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:17.510043 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-54d32f77-6551-4047-81fe-5e02e7feed81 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1094 microversion: 2.1 time: 0.069247 Aug 31 11:14:17.510608 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 540/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:17 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:18.536218 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-5196100b-99ba-4953-9d83-9706c2c2c360 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:18.537370 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-5196100b-99ba-4953-9d83-9706c2c2c360 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:18.550423 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5196100b-99ba-4953-9d83-9706c2c2c360 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:18.551454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5196100b-99ba-4953-9d83-9706c2c2c360 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:18.552264 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5196100b-99ba-4953-9d83-9706c2c2c360 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:18.552987 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5196100b-99ba-4953-9d83-9706c2c2c360 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:18.553483 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5196100b-99ba-4953-9d83-9706c2c2c360 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:18.554008 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-5196100b-99ba-4953-9d83-9706c2c2c360 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:18.662792 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-5196100b-99ba-4953-9d83-9706c2c2c360 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:18.671431 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-5196100b-99ba-4953-9d83-9706c2c2c360 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1210 microversion: 2.1 time: 0.142778 Aug 31 11:14:18.672035 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 468/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:18 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1210 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:19.692464 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-0645b4f0-aa11-4ca6-8739-640ef99c7847 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:19.693070 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-0645b4f0-aa11-4ca6-8739-640ef99c7847 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:19.700431 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0645b4f0-aa11-4ca6-8739-640ef99c7847 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:19.700841 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0645b4f0-aa11-4ca6-8739-640ef99c7847 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:19.701268 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0645b4f0-aa11-4ca6-8739-640ef99c7847 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:19.701949 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0645b4f0-aa11-4ca6-8739-640ef99c7847 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:19.702395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0645b4f0-aa11-4ca6-8739-640ef99c7847 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:19.702815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-0645b4f0-aa11-4ca6-8739-640ef99c7847 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:19.835963 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-0645b4f0-aa11-4ca6-8739-640ef99c7847 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:19.844090 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-0645b4f0-aa11-4ca6-8739-640ef99c7847 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1277 microversion: 2.1 time: 0.155460 Aug 31 11:14:19.844649 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 541/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:19 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:20.865563 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-999f75ea-bb53-4c91-82ca-76c00a740b1b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:20.866088 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-999f75ea-bb53-4c91-82ca-76c00a740b1b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:20.873176 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-999f75ea-bb53-4c91-82ca-76c00a740b1b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:20.873699 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-999f75ea-bb53-4c91-82ca-76c00a740b1b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:20.874103 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-999f75ea-bb53-4c91-82ca-76c00a740b1b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:20.874900 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-999f75ea-bb53-4c91-82ca-76c00a740b1b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:20.875363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-999f75ea-bb53-4c91-82ca-76c00a740b1b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:20.875851 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-999f75ea-bb53-4c91-82ca-76c00a740b1b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:21.004678 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-999f75ea-bb53-4c91-82ca-76c00a740b1b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:21.012342 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-999f75ea-bb53-4c91-82ca-76c00a740b1b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1277 microversion: 2.1 time: 0.150676 Aug 31 11:14:21.012910 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 469/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:20 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:21.842821 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-52b94920-2ea7-43f1-b1b8-e13095cfde7a req-47b100f3-7e2f-4452-bd5d-700ab6f29afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b0e5fc-405a-4d4d-b686-9430787260d2", "tag": "54ffd0ba-c10d-41e7-af2c-adcc9d425393"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:14:21.859545 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-52b94920-2ea7-43f1-b1b8-e13095cfde7a req-47b100f3-7e2f-4452-bd5d-700ab6f29afa service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:21.860408 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-52b94920-2ea7-43f1-b1b8-e13095cfde7a req-47b100f3-7e2f-4452-bd5d-700ab6f29afa service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:21.861254 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-52b94920-2ea7-43f1-b1b8-e13095cfde7a req-47b100f3-7e2f-4452-bd5d-700ab6f29afa service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:21.875562 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-52b94920-2ea7-43f1-b1b8-e13095cfde7a req-47b100f3-7e2f-4452-bd5d-700ab6f29afa service nova] Creating event network-changed:54ffd0ba-c10d-41e7-af2c-adcc9d425393 for instance 14b0e5fc-405a-4d4d-b686-9430787260d2 on hv-cinder-85535 Aug 31 11:14:21.881900 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-52b94920-2ea7-43f1-b1b8-e13095cfde7a req-47b100f3-7e2f-4452-bd5d-700ab6f29afa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043461 Aug 31 11:14:21.882735 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 542/1011] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:14:22.034493 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a27f1d51-9404-496e-bb8d-e03f4c2c50a2 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:22.035098 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a27f1d51-9404-496e-bb8d-e03f4c2c50a2 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:22.044340 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a27f1d51-9404-496e-bb8d-e03f4c2c50a2 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:22.044826 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a27f1d51-9404-496e-bb8d-e03f4c2c50a2 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:22.045262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a27f1d51-9404-496e-bb8d-e03f4c2c50a2 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:22.045961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a27f1d51-9404-496e-bb8d-e03f4c2c50a2 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:22.046411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a27f1d51-9404-496e-bb8d-e03f4c2c50a2 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:22.046834 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a27f1d51-9404-496e-bb8d-e03f4c2c50a2 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:22.267784 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-a27f1d51-9404-496e-bb8d-e03f4c2c50a2 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:22.275684 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a27f1d51-9404-496e-bb8d-e03f4c2c50a2 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1265 microversion: 2.1 time: 0.245553 Aug 31 11:14:22.277126 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 470/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:22 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:23.298696 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b4dce7a3-93de-4405-864d-3a6e2054b1be tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:23.299460 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b4dce7a3-93de-4405-864d-3a6e2054b1be tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:23.306031 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4dce7a3-93de-4405-864d-3a6e2054b1be tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:23.306527 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4dce7a3-93de-4405-864d-3a6e2054b1be tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:23.306966 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4dce7a3-93de-4405-864d-3a6e2054b1be tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:23.307769 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4dce7a3-93de-4405-864d-3a6e2054b1be tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:23.308441 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4dce7a3-93de-4405-864d-3a6e2054b1be tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:23.308937 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b4dce7a3-93de-4405-864d-3a6e2054b1be tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:23.446250 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b4dce7a3-93de-4405-864d-3a6e2054b1be tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:23.456755 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b4dce7a3-93de-4405-864d-3a6e2054b1be tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1265 microversion: 2.1 time: 0.162662 Aug 31 11:14:23.470283 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 543/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:23 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:24.478252 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3549747b-4a3f-4aee-a70b-864bfc2e9a26 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:24.478866 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3549747b-4a3f-4aee-a70b-864bfc2e9a26 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:24.486011 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3549747b-4a3f-4aee-a70b-864bfc2e9a26 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:24.486494 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3549747b-4a3f-4aee-a70b-864bfc2e9a26 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:24.486928 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3549747b-4a3f-4aee-a70b-864bfc2e9a26 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:24.487621 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3549747b-4a3f-4aee-a70b-864bfc2e9a26 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:24.488092 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3549747b-4a3f-4aee-a70b-864bfc2e9a26 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:24.488515 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3549747b-4a3f-4aee-a70b-864bfc2e9a26 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:24.637108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3549747b-4a3f-4aee-a70b-864bfc2e9a26 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:24.646125 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3549747b-4a3f-4aee-a70b-864bfc2e9a26 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1265 microversion: 2.1 time: 0.171667 Aug 31 11:14:24.646807 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 471/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:24 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:25.667332 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a7130ab3-26a6-44ed-8136-42cf8443a1e1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:25.667977 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a7130ab3-26a6-44ed-8136-42cf8443a1e1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:25.674635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7130ab3-26a6-44ed-8136-42cf8443a1e1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:25.675080 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7130ab3-26a6-44ed-8136-42cf8443a1e1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:25.675513 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7130ab3-26a6-44ed-8136-42cf8443a1e1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:25.676303 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7130ab3-26a6-44ed-8136-42cf8443a1e1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:25.676753 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7130ab3-26a6-44ed-8136-42cf8443a1e1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:25.677199 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a7130ab3-26a6-44ed-8136-42cf8443a1e1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:26.071095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a7130ab3-26a6-44ed-8136-42cf8443a1e1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:26.084054 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a7130ab3-26a6-44ed-8136-42cf8443a1e1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1265 microversion: 2.1 time: 0.420772 Aug 31 11:14:26.085094 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 544/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:25 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1265 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:27.106300 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-97a26bbf-fbbb-49be-99cd-335faa034315 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:27.107250 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-97a26bbf-fbbb-49be-99cd-335faa034315 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:27.110346 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:27.111235 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=6 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:27.118459 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-97a26bbf-fbbb-49be-99cd-335faa034315 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:27.118889 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-97a26bbf-fbbb-49be-99cd-335faa034315 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:27.119317 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-97a26bbf-fbbb-49be-99cd-335faa034315 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:27.120041 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-97a26bbf-fbbb-49be-99cd-335faa034315 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:27.120496 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-97a26bbf-fbbb-49be-99cd-335faa034315 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:27.120912 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-97a26bbf-fbbb-49be-99cd-335faa034315 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:27.261719 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-97a26bbf-fbbb-49be-99cd-335faa034315 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:27.269688 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-97a26bbf-fbbb-49be-99cd-335faa034315 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1265 microversion: 2.1 time: 0.168154 Aug 31 11:14:27.270262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 472/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:27 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:28.293463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4f3dbe77-7b93-493b-bfca-ebb519809e6b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:28.294030 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4f3dbe77-7b93-493b-bfca-ebb519809e6b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:28.296492 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:28.301816 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f3dbe77-7b93-493b-bfca-ebb519809e6b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:28.302305 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f3dbe77-7b93-493b-bfca-ebb519809e6b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:28.302748 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f3dbe77-7b93-493b-bfca-ebb519809e6b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:28.303570 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f3dbe77-7b93-493b-bfca-ebb519809e6b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:28.303989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f3dbe77-7b93-493b-bfca-ebb519809e6b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:28.304394 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f3dbe77-7b93-493b-bfca-ebb519809e6b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:28.445700 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4f3dbe77-7b93-493b-bfca-ebb519809e6b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:28.454176 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4f3dbe77-7b93-493b-bfca-ebb519809e6b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1265 microversion: 2.1 time: 0.165596 Aug 31 11:14:28.454747 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 545/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:28 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:29.474967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d18a6e0f-1237-4037-b7ce-cd5368ef3a5f tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:29.475996 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d18a6e0f-1237-4037-b7ce-cd5368ef3a5f tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:29.483127 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d18a6e0f-1237-4037-b7ce-cd5368ef3a5f tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:29.483723 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d18a6e0f-1237-4037-b7ce-cd5368ef3a5f tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:29.484329 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d18a6e0f-1237-4037-b7ce-cd5368ef3a5f tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:29.485143 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d18a6e0f-1237-4037-b7ce-cd5368ef3a5f tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:29.485989 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d18a6e0f-1237-4037-b7ce-cd5368ef3a5f tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:29.486578 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d18a6e0f-1237-4037-b7ce-cd5368ef3a5f tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:29.628059 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d18a6e0f-1237-4037-b7ce-cd5368ef3a5f tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:29.636537 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d18a6e0f-1237-4037-b7ce-cd5368ef3a5f tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1265 microversion: 2.1 time: 0.165468 Aug 31 11:14:29.637130 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 473/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:29 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:30.656734 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4954a3d1-3311-45de-9d6a-6f35d1462b2d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:30.657342 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4954a3d1-3311-45de-9d6a-6f35d1462b2d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:30.660096 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 11:14:30.660253 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Wed Aug 31 11:14:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 (ip 10.222.0.20) !!! Aug 31 11:14:30.669238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4954a3d1-3311-45de-9d6a-6f35d1462b2d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:30.669720 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4954a3d1-3311-45de-9d6a-6f35d1462b2d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:30.670146 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4954a3d1-3311-45de-9d6a-6f35d1462b2d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:30.670870 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4954a3d1-3311-45de-9d6a-6f35d1462b2d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:30.671317 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4954a3d1-3311-45de-9d6a-6f35d1462b2d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:30.671737 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4954a3d1-3311-45de-9d6a-6f35d1462b2d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:30.826241 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4954a3d1-3311-45de-9d6a-6f35d1462b2d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:30.834945 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4954a3d1-3311-45de-9d6a-6f35d1462b2d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1265 microversion: 2.1 time: 0.181958 Aug 31 11:14:30.835621 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 546/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:30 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:14:31.444168 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-c6641f67-5748-402e-a2a1-9284431302cf req-871bbf42-11fe-4c43-bc4c-40745236d939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b0e5fc-405a-4d4d-b686-9430787260d2", "name": "network-vif-plugged", "status": "completed", "tag": "54ffd0ba-c10d-41e7-af2c-adcc9d425393"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:14:31.458957 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-c6641f67-5748-402e-a2a1-9284431302cf req-871bbf42-11fe-4c43-bc4c-40745236d939 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:31.459634 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-c6641f67-5748-402e-a2a1-9284431302cf req-871bbf42-11fe-4c43-bc4c-40745236d939 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:31.460222 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-c6641f67-5748-402e-a2a1-9284431302cf req-871bbf42-11fe-4c43-bc4c-40745236d939 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:31.475790 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-c6641f67-5748-402e-a2a1-9284431302cf req-871bbf42-11fe-4c43-bc4c-40745236d939 service nova] Creating event network-vif-plugged:54ffd0ba-c10d-41e7-af2c-adcc9d425393 for instance 14b0e5fc-405a-4d4d-b686-9430787260d2 on hv-cinder-85535 Aug 31 11:14:31.482078 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-c6641f67-5748-402e-a2a1-9284431302cf req-871bbf42-11fe-4c43-bc4c-40745236d939 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041704 Aug 31 11:14:31.482892 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 474/1020] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:14:31.857767 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-015614f9-e30e-4dd3-bf4f-aceff6591edd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:31.858526 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-015614f9-e30e-4dd3-bf4f-aceff6591edd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:31.866071 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-015614f9-e30e-4dd3-bf4f-aceff6591edd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:31.866566 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-015614f9-e30e-4dd3-bf4f-aceff6591edd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:31.867010 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-015614f9-e30e-4dd3-bf4f-aceff6591edd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:31.867728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-015614f9-e30e-4dd3-bf4f-aceff6591edd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:31.868432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-015614f9-e30e-4dd3-bf4f-aceff6591edd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:31.868866 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-015614f9-e30e-4dd3-bf4f-aceff6591edd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:32.052070 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-015614f9-e30e-4dd3-bf4f-aceff6591edd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:32.062473 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-015614f9-e30e-4dd3-bf4f-aceff6591edd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1265 microversion: 2.1 time: 0.208982 Aug 31 11:14:32.063140 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 547/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:31 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:33.087732 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e856110c-e3a7-4ca2-b194-4b7a15b71247 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:33.092832 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e856110c-e3a7-4ca2-b194-4b7a15b71247 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:33.103538 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e856110c-e3a7-4ca2-b194-4b7a15b71247 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:33.104856 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e856110c-e3a7-4ca2-b194-4b7a15b71247 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:33.105505 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e856110c-e3a7-4ca2-b194-4b7a15b71247 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:33.106660 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e856110c-e3a7-4ca2-b194-4b7a15b71247 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:33.107404 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e856110c-e3a7-4ca2-b194-4b7a15b71247 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:33.108145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e856110c-e3a7-4ca2-b194-4b7a15b71247 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:33.284889 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e856110c-e3a7-4ca2-b194-4b7a15b71247 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:33.295336 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e856110c-e3a7-4ca2-b194-4b7a15b71247 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1452 microversion: 2.1 time: 0.212938 Aug 31 11:14:33.295973 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 475/1022] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:33 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1452 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:33.317055 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e4d1cfe6-6afb-4ae2-affa-f834a6f735b1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:14:33.317804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e4d1cfe6-6afb-4ae2-affa-f834a6f735b1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:14:33.326182 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e4d1cfe6-6afb-4ae2-affa-f834a6f735b1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:33.326865 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e4d1cfe6-6afb-4ae2-affa-f834a6f735b1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:33.327301 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e4d1cfe6-6afb-4ae2-affa-f834a6f735b1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:33.328044 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e4d1cfe6-6afb-4ae2-affa-f834a6f735b1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:33.328490 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e4d1cfe6-6afb-4ae2-affa-f834a6f735b1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:33.328919 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e4d1cfe6-6afb-4ae2-affa-f834a6f735b1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:33.495709 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-e4d1cfe6-6afb-4ae2-affa-f834a6f735b1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:14:33.504046 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e4d1cfe6-6afb-4ae2-affa-f834a6f735b1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1452 microversion: 2.1 time: 0.191337 Aug 31 11:14:33.504629 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 548/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:14:33 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1452 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:14:35.583348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-0874c2b4-9cb9-4cdd-a7bd-6e7ddc2100e6 req-737d3971-0fe4-433c-8ac3-ae689261f4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b0e5fc-405a-4d4d-b686-9430787260d2", "tag": "54ffd0ba-c10d-41e7-af2c-adcc9d425393"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:14:35.609610 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-0874c2b4-9cb9-4cdd-a7bd-6e7ddc2100e6 req-737d3971-0fe4-433c-8ac3-ae689261f4cf service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:14:35.610375 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-0874c2b4-9cb9-4cdd-a7bd-6e7ddc2100e6 req-737d3971-0fe4-433c-8ac3-ae689261f4cf service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:14:35.610904 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-0874c2b4-9cb9-4cdd-a7bd-6e7ddc2100e6 req-737d3971-0fe4-433c-8ac3-ae689261f4cf service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:14:35.628556 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-0874c2b4-9cb9-4cdd-a7bd-6e7ddc2100e6 req-737d3971-0fe4-433c-8ac3-ae689261f4cf service nova] Creating event network-changed:54ffd0ba-c10d-41e7-af2c-adcc9d425393 for instance 14b0e5fc-405a-4d4d-b686-9430787260d2 on hv-cinder-85535 Aug 31 11:14:35.634417 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-0874c2b4-9cb9-4cdd-a7bd-6e7ddc2100e6 req-737d3971-0fe4-433c-8ac3-ae689261f4cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057500 Aug 31 11:14:35.637117 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 476/1024] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:15:18.889109 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1286768462", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "networks": [{"uuid": "5f45c472-5d8c-4e07-bcb5-4fbbb38fb119"}]}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:15:18.898063 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=28 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:18.898746 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=64 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:19.119314 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] validate_networks() for [('5f45c472-5d8c-4e07-bcb5-4fbbb38fb119', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:15:19.494778 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:15:19.495311 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:15:19.495817 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:15:19.496274 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:15:19.496693 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:15:19.506208 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:19.506691 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:19.507129 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:19.507860 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:19.508414 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:19.509635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:19.528921 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Getting quotas for project 1fc761089b5740ecb88c71ff97f3f270. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:15:19.534957 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Getting quotas for user 28aff6cc28ab4118bb334d7249697e9f and project 1fc761089b5740ecb88c71ff97f3f270. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:15:19.549719 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:15:19.552158 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:15:19.604942 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-72fbd91e-7593-499c-a69a-91f812749f83 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719824 Aug 31 11:15:19.605875 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 549/1025] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 11:15:19.614718 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:19.615457 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:19.620554 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-c7760663-3b1f-4555-89e3-4a35db9a99c4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:15:19.621257 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-c7760663-3b1f-4555-89e3-4a35db9a99c4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:15:19.686776 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-c7760663-3b1f-4555-89e3-4a35db9a99c4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:15:19.698652 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-c7760663-3b1f-4555-89e3-4a35db9a99c4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1219 microversion: 2.1 time: 0.085572 Aug 31 11:15:19.699243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 477/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:15:19 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:15:20.721305 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-be800c1a-61e2-498a-a909-930b388012a5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:15:20.721929 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-be800c1a-61e2-498a-a909-930b388012a5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:15:20.729058 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-be800c1a-61e2-498a-a909-930b388012a5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:20.729551 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-be800c1a-61e2-498a-a909-930b388012a5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:20.729990 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-be800c1a-61e2-498a-a909-930b388012a5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:20.730703 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-be800c1a-61e2-498a-a909-930b388012a5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:20.731153 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-be800c1a-61e2-498a-a909-930b388012a5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:20.731571 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-be800c1a-61e2-498a-a909-930b388012a5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:20.808986 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-be800c1a-61e2-498a-a909-930b388012a5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:15:20.817021 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-be800c1a-61e2-498a-a909-930b388012a5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1271 microversion: 2.1 time: 0.100309 Aug 31 11:15:20.817614 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 550/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:15:20 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:15:21.839200 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-61fb2a88-8b35-4f50-974b-bec3f994a2f7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:15:21.840121 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-61fb2a88-8b35-4f50-974b-bec3f994a2f7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:15:21.847684 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-61fb2a88-8b35-4f50-974b-bec3f994a2f7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:21.848214 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-61fb2a88-8b35-4f50-974b-bec3f994a2f7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:21.848659 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-61fb2a88-8b35-4f50-974b-bec3f994a2f7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:21.849358 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-61fb2a88-8b35-4f50-974b-bec3f994a2f7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:21.849816 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-61fb2a88-8b35-4f50-974b-bec3f994a2f7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:21.850406 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-61fb2a88-8b35-4f50-974b-bec3f994a2f7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:22.265907 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-61fb2a88-8b35-4f50-974b-bec3f994a2f7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:15:22.274697 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-61fb2a88-8b35-4f50-974b-bec3f994a2f7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1319 microversion: 2.1 time: 0.438918 Aug 31 11:15:22.275211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 478/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:15:21 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:15:22.885436 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-39f7e531-a378-4eb2-8776-1312c81df733 req-994d4e75-ac54-4890-b851-b43cb5cf0adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d3fdc5-ff11-40b8-bd62-ef34e7d4341e", "tag": "33e2d0a0-a555-499c-900b-f87f8205e5ce"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:15:22.908354 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-39f7e531-a378-4eb2-8776-1312c81df733 req-994d4e75-ac54-4890-b851-b43cb5cf0adb service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:22.909219 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-39f7e531-a378-4eb2-8776-1312c81df733 req-994d4e75-ac54-4890-b851-b43cb5cf0adb service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:22.909965 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-39f7e531-a378-4eb2-8776-1312c81df733 req-994d4e75-ac54-4890-b851-b43cb5cf0adb service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:22.927699 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-39f7e531-a378-4eb2-8776-1312c81df733 req-994d4e75-ac54-4890-b851-b43cb5cf0adb service nova] Creating event network-changed:33e2d0a0-a555-499c-900b-f87f8205e5ce for instance 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e on hv-cinder-85535 Aug 31 11:15:22.934294 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-39f7e531-a378-4eb2-8776-1312c81df733 req-994d4e75-ac54-4890-b851-b43cb5cf0adb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057786 Aug 31 11:15:22.935689 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 551/1029] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:15:23.296260 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d19c408e-70a8-45e5-94e1-194a714a9414 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:15:23.297294 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d19c408e-70a8-45e5-94e1-194a714a9414 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:15:23.309664 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d19c408e-70a8-45e5-94e1-194a714a9414 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:23.310583 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d19c408e-70a8-45e5-94e1-194a714a9414 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:23.311408 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d19c408e-70a8-45e5-94e1-194a714a9414 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:23.312679 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d19c408e-70a8-45e5-94e1-194a714a9414 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:23.313506 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d19c408e-70a8-45e5-94e1-194a714a9414 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:23.314297 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d19c408e-70a8-45e5-94e1-194a714a9414 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:23.466451 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-d19c408e-70a8-45e5-94e1-194a714a9414 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:15:23.474446 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d19c408e-70a8-45e5-94e1-194a714a9414 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1319 microversion: 2.1 time: 0.183359 Aug 31 11:15:23.475040 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 479/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:15:23 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:15:24.496959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-83d661f2-8ea6-4e43-97ab-d1fdfd41aa4d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:15:24.497785 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-83d661f2-8ea6-4e43-97ab-d1fdfd41aa4d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:15:24.504875 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-83d661f2-8ea6-4e43-97ab-d1fdfd41aa4d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:24.505368 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-83d661f2-8ea6-4e43-97ab-d1fdfd41aa4d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:24.505812 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-83d661f2-8ea6-4e43-97ab-d1fdfd41aa4d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:24.506529 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-83d661f2-8ea6-4e43-97ab-d1fdfd41aa4d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:24.506977 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-83d661f2-8ea6-4e43-97ab-d1fdfd41aa4d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:24.507402 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-83d661f2-8ea6-4e43-97ab-d1fdfd41aa4d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:24.669511 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-83d661f2-8ea6-4e43-97ab-d1fdfd41aa4d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:15:24.678491 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-83d661f2-8ea6-4e43-97ab-d1fdfd41aa4d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1319 microversion: 2.1 time: 0.186420 Aug 31 11:15:24.679076 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 552/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:15:24 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:15:25.699825 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b18e4d4d-f586-4eed-846a-d486a1a43841 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:15:25.700513 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b18e4d4d-f586-4eed-846a-d486a1a43841 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:15:25.707249 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b18e4d4d-f586-4eed-846a-d486a1a43841 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:25.707747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b18e4d4d-f586-4eed-846a-d486a1a43841 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:25.708217 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b18e4d4d-f586-4eed-846a-d486a1a43841 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:25.708930 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b18e4d4d-f586-4eed-846a-d486a1a43841 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:25.709384 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b18e4d4d-f586-4eed-846a-d486a1a43841 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:25.709803 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b18e4d4d-f586-4eed-846a-d486a1a43841 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:25.873498 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b18e4d4d-f586-4eed-846a-d486a1a43841 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:15:25.881992 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b18e4d4d-f586-4eed-846a-d486a1a43841 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1319 microversion: 2.1 time: 0.185971 Aug 31 11:15:25.882731 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 480/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:15:25 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:15:26.903566 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a994b944-490f-437c-868c-1cdce9f2e102 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:15:26.904420 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a994b944-490f-437c-868c-1cdce9f2e102 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:15:26.912520 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a994b944-490f-437c-868c-1cdce9f2e102 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:26.913017 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a994b944-490f-437c-868c-1cdce9f2e102 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:26.913456 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a994b944-490f-437c-868c-1cdce9f2e102 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:26.914723 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a994b944-490f-437c-868c-1cdce9f2e102 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:26.915231 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a994b944-490f-437c-868c-1cdce9f2e102 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:26.915668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a994b944-490f-437c-868c-1cdce9f2e102 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:27.064849 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a994b944-490f-437c-868c-1cdce9f2e102 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:15:27.073857 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a994b944-490f-437c-868c-1cdce9f2e102 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1319 microversion: 2.1 time: 0.174195 Aug 31 11:15:27.074503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 553/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:15:26 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:15:28.099651 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3d403963-6989-480b-80cb-da74336fb4e7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:15:28.101089 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3d403963-6989-480b-80cb-da74336fb4e7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:15:28.113146 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3d403963-6989-480b-80cb-da74336fb4e7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:28.114010 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3d403963-6989-480b-80cb-da74336fb4e7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:28.115463 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3d403963-6989-480b-80cb-da74336fb4e7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:28.115906 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3d403963-6989-480b-80cb-da74336fb4e7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:28.116770 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3d403963-6989-480b-80cb-da74336fb4e7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:28.118181 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3d403963-6989-480b-80cb-da74336fb4e7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:28.290183 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3d403963-6989-480b-80cb-da74336fb4e7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:15:28.298332 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3d403963-6989-480b-80cb-da74336fb4e7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1319 microversion: 2.1 time: 0.206151 Aug 31 11:15:28.299025 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 481/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:15:28 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:15:29.319734 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4aa54127-b6b6-4daf-96ba-ca40de2d1cc0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:15:29.321184 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4aa54127-b6b6-4daf-96ba-ca40de2d1cc0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:15:29.328137 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4aa54127-b6b6-4daf-96ba-ca40de2d1cc0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:29.328648 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4aa54127-b6b6-4daf-96ba-ca40de2d1cc0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:29.329066 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4aa54127-b6b6-4daf-96ba-ca40de2d1cc0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:29.329787 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4aa54127-b6b6-4daf-96ba-ca40de2d1cc0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:29.330237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4aa54127-b6b6-4daf-96ba-ca40de2d1cc0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:29.330652 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4aa54127-b6b6-4daf-96ba-ca40de2d1cc0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:29.478045 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4aa54127-b6b6-4daf-96ba-ca40de2d1cc0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:15:29.486623 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4aa54127-b6b6-4daf-96ba-ca40de2d1cc0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1319 microversion: 2.1 time: 0.170794 Aug 31 11:15:29.487237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 554/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:15:29 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:15:29.770881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-c7542b7b-a9cb-4e84-a935-87437eccf083 req-5f0d234b-a2e8-4170-b7d4-1d59c1ea9753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d3fdc5-ff11-40b8-bd62-ef34e7d4341e", "name": "network-vif-plugged", "status": "completed", "tag": "33e2d0a0-a555-499c-900b-f87f8205e5ce"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:15:29.779858 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:29.786844 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-c7542b7b-a9cb-4e84-a935-87437eccf083 req-5f0d234b-a2e8-4170-b7d4-1d59c1ea9753 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:29.787646 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-c7542b7b-a9cb-4e84-a935-87437eccf083 req-5f0d234b-a2e8-4170-b7d4-1d59c1ea9753 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:29.788147 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-c7542b7b-a9cb-4e84-a935-87437eccf083 req-5f0d234b-a2e8-4170-b7d4-1d59c1ea9753 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:29.954211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-c7542b7b-a9cb-4e84-a935-87437eccf083 req-5f0d234b-a2e8-4170-b7d4-1d59c1ea9753 service nova] Creating event network-vif-plugged:33e2d0a0-a555-499c-900b-f87f8205e5ce for instance 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e on hv-cinder-85535 Aug 31 11:15:29.959538 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-c7542b7b-a9cb-4e84-a935-87437eccf083 req-5f0d234b-a2e8-4170-b7d4-1d59c1ea9753 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193168 Aug 31 11:15:29.960171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 482/1036] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:15:30.509004 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-2b138598-311e-481d-9c4b-8db2680d2768 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:15:30.509738 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-2b138598-311e-481d-9c4b-8db2680d2768 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:15:30.511595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:30.512377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=6 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:30.518900 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2b138598-311e-481d-9c4b-8db2680d2768 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:30.519381 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2b138598-311e-481d-9c4b-8db2680d2768 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:30.519811 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2b138598-311e-481d-9c4b-8db2680d2768 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:30.520547 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2b138598-311e-481d-9c4b-8db2680d2768 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:30.520995 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2b138598-311e-481d-9c4b-8db2680d2768 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:30.521413 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-2b138598-311e-481d-9c4b-8db2680d2768 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:30.672103 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-2b138598-311e-481d-9c4b-8db2680d2768 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:15:30.681246 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-2b138598-311e-481d-9c4b-8db2680d2768 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1319 microversion: 2.1 time: 0.176957 Aug 31 11:15:30.681829 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 555/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:15:30 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:15:31.708122 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-beaebd88-35b7-4fe5-b496-e56867f4f428 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:15:31.709092 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-beaebd88-35b7-4fe5-b496-e56867f4f428 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:15:31.716536 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-beaebd88-35b7-4fe5-b496-e56867f4f428 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:31.717032 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-beaebd88-35b7-4fe5-b496-e56867f4f428 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:31.717510 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-beaebd88-35b7-4fe5-b496-e56867f4f428 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:31.718262 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-beaebd88-35b7-4fe5-b496-e56867f4f428 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:31.718719 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-beaebd88-35b7-4fe5-b496-e56867f4f428 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:31.719145 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-beaebd88-35b7-4fe5-b496-e56867f4f428 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:31.923399 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-beaebd88-35b7-4fe5-b496-e56867f4f428 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:15:31.932941 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-beaebd88-35b7-4fe5-b496-e56867f4f428 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1507 microversion: 2.1 time: 0.229627 Aug 31 11:15:31.933680 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 483/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:15:31 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:15:46.410185 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6d0d1f96-fdbb-46ba-9c92-1baea63268b8 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "596c0e94-e636-4b57-be4b-3d2746b2a099", "device": "/dev/sdb"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:15:46.413831 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6d0d1f96-fdbb-46ba-9c92-1baea63268b8 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:15:46.416485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:46.417392 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=34 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:46.423527 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d0d1f96-fdbb-46ba-9c92-1baea63268b8 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:46.424065 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d0d1f96-fdbb-46ba-9c92-1baea63268b8 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:46.424501 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d0d1f96-fdbb-46ba-9c92-1baea63268b8 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:46.425225 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d0d1f96-fdbb-46ba-9c92-1baea63268b8 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:15:46.425678 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d0d1f96-fdbb-46ba-9c92-1baea63268b8 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:15:46.426102 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6d0d1f96-fdbb-46ba-9c92-1baea63268b8 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:15:46.706917 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6d0d1f96-fdbb-46ba-9c92-1baea63268b8 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "POST /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300470 Aug 31 11:15:46.708107 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 556/1039] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:15:46 2022] POST /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:16:06.680284 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-de076050-cd2d-4ea4-8721-2d229b9590e2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:06.681196 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-de076050-cd2d-4ea4-8721-2d229b9590e2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:06.685205 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=16 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:06.686330 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=32 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:06.687446 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 11:16:06.687606 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Wed Aug 31 11:16:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e/os-volume_attachments/596c0e94-e636-4b57-be4b-3d2746b2a099 (ip 10.222.0.20) !!! Aug 31 11:16:06.698027 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de076050-cd2d-4ea4-8721-2d229b9590e2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:06.698523 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de076050-cd2d-4ea4-8721-2d229b9590e2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:06.698991 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de076050-cd2d-4ea4-8721-2d229b9590e2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:06.699715 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de076050-cd2d-4ea4-8721-2d229b9590e2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:06.700216 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de076050-cd2d-4ea4-8721-2d229b9590e2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:06.700681 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-de076050-cd2d-4ea4-8721-2d229b9590e2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:06.793626 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-de076050-cd2d-4ea4-8721-2d229b9590e2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lazy-loading 'services' on Instance uuid 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:16:06.875670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-de076050-cd2d-4ea4-8721-2d229b9590e2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "DELETE /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e/os-volume_attachments/596c0e94-e636-4b57-be4b-3d2746b2a099" status: 202 len: 0 microversion: 2.1 time: 0.203640 Aug 31 11:16:06.876577 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 484/1040] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 11:16:06 2022] DELETE /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e/os-volume_attachments/596c0e94-e636-4b57-be4b-3d2746b2a099 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:16:08.030420 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-cbeb2a59-e6e4-4b23-bac8-e15f4fa56221 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:08.031074 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-cbeb2a59-e6e4-4b23-bac8-e15f4fa56221 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:08.033900 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:08.034908 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:08.043556 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cbeb2a59-e6e4-4b23-bac8-e15f4fa56221 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:08.044142 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cbeb2a59-e6e4-4b23-bac8-e15f4fa56221 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:08.044622 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cbeb2a59-e6e4-4b23-bac8-e15f4fa56221 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:08.045345 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cbeb2a59-e6e4-4b23-bac8-e15f4fa56221 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:08.045801 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cbeb2a59-e6e4-4b23-bac8-e15f4fa56221 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:08.046217 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-cbeb2a59-e6e4-4b23-bac8-e15f4fa56221 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:08.100780 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-cbeb2a59-e6e4-4b23-bac8-e15f4fa56221 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:16:08.209677 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-cbeb2a59-e6e4-4b23-bac8-e15f4fa56221 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "DELETE /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 204 len: 0 microversion: 2.1 time: 0.182718 Aug 31 11:16:08.210666 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 557/1041] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:16:08 2022] DELETE /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:16:08.220959 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-6bec8bee-1c53-4d6a-bcf7-4cff467d9584 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:08.221649 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-6bec8bee-1c53-4d6a-bcf7-4cff467d9584 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:08.230067 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bec8bee-1c53-4d6a-bcf7-4cff467d9584 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:08.230724 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bec8bee-1c53-4d6a-bcf7-4cff467d9584 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:08.231289 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bec8bee-1c53-4d6a-bcf7-4cff467d9584 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:08.232175 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bec8bee-1c53-4d6a-bcf7-4cff467d9584 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:08.232746 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bec8bee-1c53-4d6a-bcf7-4cff467d9584 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:08.233272 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-6bec8bee-1c53-4d6a-bcf7-4cff467d9584 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:08.387498 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-6bec8bee-1c53-4d6a-bcf7-4cff467d9584 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:08.397593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-6bec8bee-1c53-4d6a-bcf7-4cff467d9584 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1513 microversion: 2.1 time: 0.180827 Aug 31 11:16:08.398189 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 485/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:08 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:09.420836 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fabe3bf1-cfda-4de8-b5db-ee88e75eae45 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:09.421691 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fabe3bf1-cfda-4de8-b5db-ee88e75eae45 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:09.430028 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fabe3bf1-cfda-4de8-b5db-ee88e75eae45 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:09.430759 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fabe3bf1-cfda-4de8-b5db-ee88e75eae45 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:09.431252 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fabe3bf1-cfda-4de8-b5db-ee88e75eae45 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:09.432323 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fabe3bf1-cfda-4de8-b5db-ee88e75eae45 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:09.432904 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fabe3bf1-cfda-4de8-b5db-ee88e75eae45 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:09.433449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fabe3bf1-cfda-4de8-b5db-ee88e75eae45 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:09.582130 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fabe3bf1-cfda-4de8-b5db-ee88e75eae45 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:09.591222 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fabe3bf1-cfda-4de8-b5db-ee88e75eae45 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1513 microversion: 2.1 time: 0.175286 Aug 31 11:16:09.592229 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 558/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:09 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:10.329131 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-fa01a5a2-0fc7-46a4-b243-e43b15bd82b0 req-7a540a91-5448-429d-b4ae-8a3da74f97b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d3fdc5-ff11-40b8-bd62-ef34e7d4341e", "name": "network-vif-deleted", "tag": "33e2d0a0-a555-499c-900b-f87f8205e5ce"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:16:10.343515 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-fa01a5a2-0fc7-46a4-b243-e43b15bd82b0 req-7a540a91-5448-429d-b4ae-8a3da74f97b5 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:10.344255 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-fa01a5a2-0fc7-46a4-b243-e43b15bd82b0 req-7a540a91-5448-429d-b4ae-8a3da74f97b5 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:10.344805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-fa01a5a2-0fc7-46a4-b243-e43b15bd82b0 req-7a540a91-5448-429d-b4ae-8a3da74f97b5 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:10.359326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-fa01a5a2-0fc7-46a4-b243-e43b15bd82b0 req-7a540a91-5448-429d-b4ae-8a3da74f97b5 service nova] Creating event network-vif-deleted:33e2d0a0-a555-499c-900b-f87f8205e5ce for instance 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e on hv-cinder-85535 Aug 31 11:16:10.365995 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-fa01a5a2-0fc7-46a4-b243-e43b15bd82b0 req-7a540a91-5448-429d-b4ae-8a3da74f97b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130595 Aug 31 11:16:10.366803 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 486/1044] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:16:10.616684 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:10.617695 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:10.624878 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:10.625524 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:10.626064 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:10.627019 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:10.627574 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:10.628148 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:10.664708 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 11:16:10.665020 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Wed Aug 31 11:16:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e (ip 10.222.0.20) !!! Aug 31 11:16:10.672497 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:10.673004 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:10.673423 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:10.673875 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lazy-loading 'fault' on Instance uuid 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:16:10.734985 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:10.745358 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-815c15c3-24c2-4e09-8265-96d38fa60673 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 200 len: 1309 microversion: 2.1 time: 0.132899 Aug 31 11:16:10.754376 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 559/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:10 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 1309 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:11.776974 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a9cc7de8-703c-40b7-b79b-d93bff02dacb tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:11.777797 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-a9cc7de8-703c-40b7-b79b-d93bff02dacb tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:11.785586 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a9cc7de8-703c-40b7-b79b-d93bff02dacb tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:11.786080 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a9cc7de8-703c-40b7-b79b-d93bff02dacb tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:11.786557 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a9cc7de8-703c-40b7-b79b-d93bff02dacb tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:11.787292 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a9cc7de8-703c-40b7-b79b-d93bff02dacb tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:11.787758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a9cc7de8-703c-40b7-b79b-d93bff02dacb tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:11.788232 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-a9cc7de8-703c-40b7-b79b-d93bff02dacb tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:11.803403 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-a9cc7de8-703c-40b7-b79b-d93bff02dacb tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] HTTP exception thrown: Instance 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e could not be found. Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a9cc7de8-703c-40b7-b79b-d93bff02dacb tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Request method failure captured: Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e HTTP/1.1 Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0LF_5ivNUcq01AvZwQTHN1tY_PAPHkvByVl1VoeMejChAi2hGJUnMa1YfBhzOczlkJ2IGBqaJU9Kr6FXo8vPHzLJIDxUx2bC6qTGn8ZazBagoBdJfq0Nn43mI7lnKPqzNGv4YWrjHa011Xy5Dhcp_q75WXFVDnKRnxX8OnF9DNan5g Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 1fc761089b5740ecb88c71ff97f3f270 Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1261193041 Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:16:11.805171 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:16:11.808243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1fc761089b5740ecb88c71ff97f3f270"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1fc761089b5740ecb88c71ff97f3f270"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fc761089b5740ecb88c71ff97f3f270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fc761089b5740ecb88c71ff97f3f270"}]}] Aug 31 11:16:11.808243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-VolumesSnapshotTestJSON-1261193041 Aug 31 11:16:11.808243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 1fc761089b5740ecb88c71ff97f3f270 Aug 31 11:16:11.808243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1261193041 Aug 31 11:16:11.808243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-VolumesSnapshotTestJSON-1261193041-project Aug 31 11:16:11.808243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:16:11.808243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:16:11.808243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 28aff6cc28ab4118bb334d7249697e9f Aug 31 11:16:11.808243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-VolumesSnapshotTestJSON-1261193041-project Aug 31 11:16:11.808243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:16:11.808243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e could not be found. Aug 31 11:16:11.808243 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '67d3fdc5-ff11-40b8-bd62-ef34e7d4341e'} Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e could not be found. Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:16:11.809805 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e could not be found. Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e could not be found. Aug 31 11:16:11.815326 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:16:11.817605 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-a9cc7de8-703c-40b7-b79b-d93bff02dacb tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Returning 404 to user: Instance 67d3fdc5-ff11-40b8-bd62-ef34e7d4341e could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:16:11.817605 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-a9cc7de8-703c-40b7-b79b-d93bff02dacb tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e" status: 404 len: 111 microversion: 2.1 time: 0.036055 Aug 31 11:16:11.817605 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 487/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:11 2022] GET /compute/v2.1/servers/67d3fdc5-ff11-40b8-bd62-ef34e7d4341e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:16:19.893131 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-575384526", "imageRef": "d5725f0d-1310-4a23-b18d-6ca9be52225a", "flavorRef": "452", "networks": [{"uuid": "5f45c472-5d8c-4e07-bcb5-4fbbb38fb119"}]}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:16:19.963287 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.network.neutron [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] validate_networks() for [('5f45c472-5d8c-4e07-bcb5-4fbbb38fb119', None, None, None, None, None)] {{(pid=120654) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:16:20.466708 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Flavor limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:16:20.467119 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Image limits 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:16:20.467657 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Flavor pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:16:20.468123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Image pref 0:0:0 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:16:20.468599 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.virt.hardware [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:16:20.480203 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:20.480688 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:20.481216 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:20.481967 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:20.482419 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:20.482841 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:20.503642 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Getting quotas for project 1fc761089b5740ecb88c71ff97f3f270. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:16:20.509497 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.quota [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Getting quotas for user 28aff6cc28ab4118bb334d7249697e9f and project 1fc761089b5740ecb88c71ff97f3f270. Resources: {'ram', 'cores', 'instances'} {{(pid=120654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:16:20.526598 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Going to run 1 instances... {{(pid=120654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:16:20.531138 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5725f0d-1310-4a23-b18d-6ca9be52225a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:16:20.620194 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-6207796f-8f73-4972-b51f-2f12baebf9a9 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730560 Aug 31 11:16:20.621417 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 560/1047] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:16:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:16:20.634634 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cf52abf9-5a8b-4c48-b731-040073f663b5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:20.635306 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-cf52abf9-5a8b-4c48-b731-040073f663b5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:20.707684 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-cf52abf9-5a8b-4c48-b731-040073f663b5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:20.718473 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-cf52abf9-5a8b-4c48-b731-040073f663b5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1218 microversion: 2.1 time: 0.088985 Aug 31 11:16:20.719371 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 488/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:20 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:21.742867 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4f43215b-6b3e-4cd5-912c-1357d0280aa0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:21.743825 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4f43215b-6b3e-4cd5-912c-1357d0280aa0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:21.751254 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f43215b-6b3e-4cd5-912c-1357d0280aa0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:21.751792 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f43215b-6b3e-4cd5-912c-1357d0280aa0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:21.752320 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f43215b-6b3e-4cd5-912c-1357d0280aa0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:21.753168 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f43215b-6b3e-4cd5-912c-1357d0280aa0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:21.753708 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f43215b-6b3e-4cd5-912c-1357d0280aa0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:21.754185 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4f43215b-6b3e-4cd5-912c-1357d0280aa0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:21.835854 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4f43215b-6b3e-4cd5-912c-1357d0280aa0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:21.844222 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4f43215b-6b3e-4cd5-912c-1357d0280aa0 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1222 microversion: 2.1 time: 0.106467 Aug 31 11:16:21.844902 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 561/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:21 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:16:22.871213 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-90dc25d7-a71f-4961-94bf-5c7a4a83fc51 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:22.872608 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-90dc25d7-a71f-4961-94bf-5c7a4a83fc51 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:22.878355 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:22.889785 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90dc25d7-a71f-4961-94bf-5c7a4a83fc51 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:22.890647 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90dc25d7-a71f-4961-94bf-5c7a4a83fc51 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:22.891463 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90dc25d7-a71f-4961-94bf-5c7a4a83fc51 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:22.892796 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90dc25d7-a71f-4961-94bf-5c7a4a83fc51 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:22.893606 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90dc25d7-a71f-4961-94bf-5c7a4a83fc51 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:22.894624 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-90dc25d7-a71f-4961-94bf-5c7a4a83fc51 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:22.996179 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-90dc25d7-a71f-4961-94bf-5c7a4a83fc51 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:23.006373 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-90dc25d7-a71f-4961-94bf-5c7a4a83fc51 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1214 microversion: 2.1 time: 0.143670 Aug 31 11:16:23.006987 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 489/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:22 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:24.030865 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-941e20d5-476e-4eb9-9dcb-98b94d056f7d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:24.031719 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-941e20d5-476e-4eb9-9dcb-98b94d056f7d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:24.041110 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-941e20d5-476e-4eb9-9dcb-98b94d056f7d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:24.041635 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-941e20d5-476e-4eb9-9dcb-98b94d056f7d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:24.042087 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-941e20d5-476e-4eb9-9dcb-98b94d056f7d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:24.042847 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-941e20d5-476e-4eb9-9dcb-98b94d056f7d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:24.043315 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-941e20d5-476e-4eb9-9dcb-98b94d056f7d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:24.043742 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-941e20d5-476e-4eb9-9dcb-98b94d056f7d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:24.122344 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-941e20d5-476e-4eb9-9dcb-98b94d056f7d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:24.131863 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-941e20d5-476e-4eb9-9dcb-98b94d056f7d tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1276 microversion: 2.1 time: 0.105397 Aug 31 11:16:24.139163 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 562/1051] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:24 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1276 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:25.163398 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-09c469f6-ce2f-4cbe-8690-46de1232ba6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:25.164565 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-09c469f6-ce2f-4cbe-8690-46de1232ba6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:25.174855 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-09c469f6-ce2f-4cbe-8690-46de1232ba6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:25.175526 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-09c469f6-ce2f-4cbe-8690-46de1232ba6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:25.176156 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-09c469f6-ce2f-4cbe-8690-46de1232ba6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:25.177670 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-09c469f6-ce2f-4cbe-8690-46de1232ba6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:25.178336 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-09c469f6-ce2f-4cbe-8690-46de1232ba6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:25.178849 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-09c469f6-ce2f-4cbe-8690-46de1232ba6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:25.471500 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-09c469f6-ce2f-4cbe-8690-46de1232ba6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:25.482219 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-09c469f6-ce2f-4cbe-8690-46de1232ba6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1318 microversion: 2.1 time: 0.325842 Aug 31 11:16:25.482821 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 490/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:25 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:25.643187 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-87173314-3f01-49d6-a3d9-041ec39089ce req-a3d8e180-67dc-45ba-ac05-943b61a504ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a056ae7-62ac-4da2-997a-b4798877ce09", "tag": "8cfcaca2-cc80-404e-987d-6c3b2b9ebc17"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:16:25.667536 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-87173314-3f01-49d6-a3d9-041ec39089ce req-a3d8e180-67dc-45ba-ac05-943b61a504ef service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:25.668430 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-87173314-3f01-49d6-a3d9-041ec39089ce req-a3d8e180-67dc-45ba-ac05-943b61a504ef service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:25.669513 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-87173314-3f01-49d6-a3d9-041ec39089ce req-a3d8e180-67dc-45ba-ac05-943b61a504ef service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:25.692687 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-87173314-3f01-49d6-a3d9-041ec39089ce req-a3d8e180-67dc-45ba-ac05-943b61a504ef service nova] Creating event network-changed:8cfcaca2-cc80-404e-987d-6c3b2b9ebc17 for instance 6a056ae7-62ac-4da2-997a-b4798877ce09 on hv-cinder-85535 Aug 31 11:16:25.704633 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-87173314-3f01-49d6-a3d9-041ec39089ce req-a3d8e180-67dc-45ba-ac05-943b61a504ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068470 Aug 31 11:16:25.705981 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 563/1053] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:16:25.959990 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-615592920", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1158123877", "security_groups": [{"name": "tempest-secgroup-smoke-320297181"}], "block_device_mapping_v2": [{"uuid": "a9fc9558-bc1b-4067-8ea9-ac59ce3127ae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fdfc4a33-02c2-4205-b00d-34df8bb675d5"}]}} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:16:26.294176 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.network.neutron [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] validate_networks() for [('fdfc4a33-02c2-4205-b00d-34df8bb675d5', None, None, None, None, None)] {{(pid=120655) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:16:26.521528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-197af1e4-677a-4095-a311-76483153b58a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:26.522820 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-197af1e4-677a-4095-a311-76483153b58a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:26.533872 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-197af1e4-677a-4095-a311-76483153b58a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:26.535179 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-197af1e4-677a-4095-a311-76483153b58a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:26.536055 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-197af1e4-677a-4095-a311-76483153b58a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:26.537421 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-197af1e4-677a-4095-a311-76483153b58a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:26.538098 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-197af1e4-677a-4095-a311-76483153b58a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:26.538798 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-197af1e4-677a-4095-a311-76483153b58a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:26.751644 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-197af1e4-677a-4095-a311-76483153b58a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:26.767657 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-197af1e4-677a-4095-a311-76483153b58a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1318 microversion: 2.1 time: 0.255445 Aug 31 11:16:26.769451 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 564/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:26 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:27.159898 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Flavor limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:16:27.160343 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Image limits 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:16:27.160839 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Flavor pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:16:27.161252 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Image pref 0:0:0 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:16:27.161760 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.virt.hardware [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:16:27.172628 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:27.173253 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:27.173801 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:27.174647 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:27.175205 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:27.175730 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:27.197184 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Getting quotas for project da5b36cb688f49e1bf1cf75a108858fa. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:16:27.201994 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.quota [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Getting quotas for user 16696c34de254f3babf538c879f2ce49 and project da5b36cb688f49e1bf1cf75a108858fa. Resources: {'ram', 'cores', 'instances'} {{(pid=120655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:16:27.268585 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Going to run 1 instances... {{(pid=120655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:16:27.271280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a9fc9558-bc1b-4067-8ea9-ac59ce3127ae',volume_size=None,volume_type=None)] {{(pid=120655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:16:27.432067 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3ee390c4-cec9-4486-93a3-df2cee18f5c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.478413 Aug 31 11:16:27.433167 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 491/1055] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 11:16:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:16:27.448921 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-05792ae8-58e0-40cb-8567-58599d496e4c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:27.449836 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-05792ae8-58e0-40cb-8567-58599d496e4c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:27.525621 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-05792ae8-58e0-40cb-8567-58599d496e4c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:27.538875 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-05792ae8-58e0-40cb-8567-58599d496e4c tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1094 microversion: 2.1 time: 0.093949 Aug 31 11:16:27.539935 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 565/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:27 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:16:27.805960 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-e187d42e-f296-4f6a-ab59-5adeefdb3fd4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:27.807454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-e187d42e-f296-4f6a-ab59-5adeefdb3fd4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:27.819230 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e187d42e-f296-4f6a-ab59-5adeefdb3fd4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:27.820063 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e187d42e-f296-4f6a-ab59-5adeefdb3fd4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:27.820878 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e187d42e-f296-4f6a-ab59-5adeefdb3fd4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:27.821992 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e187d42e-f296-4f6a-ab59-5adeefdb3fd4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:27.823072 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e187d42e-f296-4f6a-ab59-5adeefdb3fd4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:27.823791 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-e187d42e-f296-4f6a-ab59-5adeefdb3fd4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:28.226595 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-e187d42e-f296-4f6a-ab59-5adeefdb3fd4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:28.242245 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-e187d42e-f296-4f6a-ab59-5adeefdb3fd4 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1318 microversion: 2.1 time: 0.444262 Aug 31 11:16:28.259199 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 492/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:27 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:28.561482 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ad518ff3-3d23-4e99-997d-3469a6ff5dc7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:28.562259 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ad518ff3-3d23-4e99-997d-3469a6ff5dc7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:28.571503 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ad518ff3-3d23-4e99-997d-3469a6ff5dc7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:28.572160 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ad518ff3-3d23-4e99-997d-3469a6ff5dc7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:28.572701 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ad518ff3-3d23-4e99-997d-3469a6ff5dc7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:28.573532 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ad518ff3-3d23-4e99-997d-3469a6ff5dc7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:28.574108 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ad518ff3-3d23-4e99-997d-3469a6ff5dc7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:28.574578 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ad518ff3-3d23-4e99-997d-3469a6ff5dc7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:28.641703 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-ad518ff3-3d23-4e99-997d-3469a6ff5dc7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:28.650929 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ad518ff3-3d23-4e99-997d-3469a6ff5dc7 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1192 microversion: 2.1 time: 0.093462 Aug 31 11:16:28.651507 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 566/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:28 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:16:29.275937 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3c786d42-65c8-43e2-bc57-721691026e8e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:29.276857 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3c786d42-65c8-43e2-bc57-721691026e8e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:29.284118 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3c786d42-65c8-43e2-bc57-721691026e8e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:29.284706 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3c786d42-65c8-43e2-bc57-721691026e8e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:29.285206 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3c786d42-65c8-43e2-bc57-721691026e8e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:29.286521 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3c786d42-65c8-43e2-bc57-721691026e8e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:29.286982 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3c786d42-65c8-43e2-bc57-721691026e8e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:29.287467 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3c786d42-65c8-43e2-bc57-721691026e8e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:29.621650 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3c786d42-65c8-43e2-bc57-721691026e8e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:29.632142 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3c786d42-65c8-43e2-bc57-721691026e8e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1318 microversion: 2.1 time: 0.360924 Aug 31 11:16:29.633030 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 493/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:29 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:29.673754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-fbfcceb1-bb18-4f3d-b30a-3dfb3108df33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:29.674772 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-fbfcceb1-bb18-4f3d-b30a-3dfb3108df33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:29.682064 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fbfcceb1-bb18-4f3d-b30a-3dfb3108df33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:29.682552 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fbfcceb1-bb18-4f3d-b30a-3dfb3108df33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:29.682984 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fbfcceb1-bb18-4f3d-b30a-3dfb3108df33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:29.683706 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fbfcceb1-bb18-4f3d-b30a-3dfb3108df33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:29.684213 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fbfcceb1-bb18-4f3d-b30a-3dfb3108df33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:29.684636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-fbfcceb1-bb18-4f3d-b30a-3dfb3108df33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:29.768263 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-fbfcceb1-bb18-4f3d-b30a-3dfb3108df33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:29.791636 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-fbfcceb1-bb18-4f3d-b30a-3dfb3108df33 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1198 microversion: 2.1 time: 0.122145 Aug 31 11:16:29.792449 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 567/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:29 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1198 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:30.657708 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-57b1ae0e-e744-4992-89fb-3dccb98c1904 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:30.659184 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-57b1ae0e-e744-4992-89fb-3dccb98c1904 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:30.668804 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57b1ae0e-e744-4992-89fb-3dccb98c1904 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:30.670128 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57b1ae0e-e744-4992-89fb-3dccb98c1904 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:30.670903 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57b1ae0e-e744-4992-89fb-3dccb98c1904 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:30.672244 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57b1ae0e-e744-4992-89fb-3dccb98c1904 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:30.673364 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57b1ae0e-e744-4992-89fb-3dccb98c1904 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:30.674256 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-57b1ae0e-e744-4992-89fb-3dccb98c1904 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:30.815752 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-eec7d699-24f1-407d-8bb4-2582c80ed23b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:30.817314 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-eec7d699-24f1-407d-8bb4-2582c80ed23b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:30.820524 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=2 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:30.829332 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-eec7d699-24f1-407d-8bb4-2582c80ed23b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:30.830064 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-eec7d699-24f1-407d-8bb4-2582c80ed23b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:30.830694 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-eec7d699-24f1-407d-8bb4-2582c80ed23b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:30.831554 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-eec7d699-24f1-407d-8bb4-2582c80ed23b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:30.832258 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-eec7d699-24f1-407d-8bb4-2582c80ed23b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:30.833059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-eec7d699-24f1-407d-8bb4-2582c80ed23b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:30.955287 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-57b1ae0e-e744-4992-89fb-3dccb98c1904 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:30.982042 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-57b1ae0e-e744-4992-89fb-3dccb98c1904 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1318 microversion: 2.1 time: 0.330212 Aug 31 11:16:30.985020 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 494/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:30 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:31.003601 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-fb7ffa44-71b0-4a48-838f-995a572cf492 req-951dcfda-7168-46a0-a45c-30c77e89746e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd0493b-103b-4ecb-ae59-72e5d411599d", "tag": "bbc26ac4-8854-4a58-bd94-d4099fa4cb35"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:16:31.019298 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-fb7ffa44-71b0-4a48-838f-995a572cf492 req-951dcfda-7168-46a0-a45c-30c77e89746e service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:31.020293 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-fb7ffa44-71b0-4a48-838f-995a572cf492 req-951dcfda-7168-46a0-a45c-30c77e89746e service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:31.021065 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-fb7ffa44-71b0-4a48-838f-995a572cf492 req-951dcfda-7168-46a0-a45c-30c77e89746e service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:31.035152 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-fb7ffa44-71b0-4a48-838f-995a572cf492 req-951dcfda-7168-46a0-a45c-30c77e89746e service nova] Creating event network-changed:bbc26ac4-8854-4a58-bd94-d4099fa4cb35 for instance 5cd0493b-103b-4ecb-ae59-72e5d411599d on hv-cinder-85535 Aug 31 11:16:31.043254 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-fb7ffa44-71b0-4a48-838f-995a572cf492 req-951dcfda-7168-46a0-a45c-30c77e89746e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055710 Aug 31 11:16:31.044443 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 495/1062] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:16:31.044949 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-eec7d699-24f1-407d-8bb4-2582c80ed23b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:31.054401 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-eec7d699-24f1-407d-8bb4-2582c80ed23b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.243571 Aug 31 11:16:31.055001 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 568/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:30 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:32.024743 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-88d29e3d-c184-49a3-a3df-6661590a2a6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:32.026063 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-88d29e3d-c184-49a3-a3df-6661590a2a6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:32.038462 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-88d29e3d-c184-49a3-a3df-6661590a2a6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:32.039827 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-88d29e3d-c184-49a3-a3df-6661590a2a6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:32.041081 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-88d29e3d-c184-49a3-a3df-6661590a2a6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:32.042277 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-88d29e3d-c184-49a3-a3df-6661590a2a6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:32.043087 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-88d29e3d-c184-49a3-a3df-6661590a2a6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:32.043863 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-88d29e3d-c184-49a3-a3df-6661590a2a6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:32.078111 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-8900a56d-d5b2-46bc-8854-7ede0951a470 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:32.079804 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-8900a56d-d5b2-46bc-8854-7ede0951a470 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:32.090662 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8900a56d-d5b2-46bc-8854-7ede0951a470 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:32.092278 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8900a56d-d5b2-46bc-8854-7ede0951a470 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:32.093006 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8900a56d-d5b2-46bc-8854-7ede0951a470 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:32.093979 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8900a56d-d5b2-46bc-8854-7ede0951a470 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:32.094637 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8900a56d-d5b2-46bc-8854-7ede0951a470 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:32.095772 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-8900a56d-d5b2-46bc-8854-7ede0951a470 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:32.328502 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-88d29e3d-c184-49a3-a3df-6661590a2a6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:32.339031 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-88d29e3d-c184-49a3-a3df-6661590a2a6a tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1318 microversion: 2.1 time: 0.323102 Aug 31 11:16:32.340383 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 496/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:32 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:32.360580 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-8900a56d-d5b2-46bc-8854-7ede0951a470 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:32.371711 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-8900a56d-d5b2-46bc-8854-7ede0951a470 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.299618 Aug 31 11:16:32.372666 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 569/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:32 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:16:32.440055 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-5f4712b0-220a-40ce-a6c5-00e87e2be968 req-1b856b5b-3580-4983-acac-9a3b4973ab3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a056ae7-62ac-4da2-997a-b4798877ce09", "name": "network-vif-plugged", "status": "completed", "tag": "8cfcaca2-cc80-404e-987d-6c3b2b9ebc17"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:16:32.452231 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5f4712b0-220a-40ce-a6c5-00e87e2be968 req-1b856b5b-3580-4983-acac-9a3b4973ab3f service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:32.453015 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5f4712b0-220a-40ce-a6c5-00e87e2be968 req-1b856b5b-3580-4983-acac-9a3b4973ab3f service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:32.453565 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-5f4712b0-220a-40ce-a6c5-00e87e2be968 req-1b856b5b-3580-4983-acac-9a3b4973ab3f service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:32.470408 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-5f4712b0-220a-40ce-a6c5-00e87e2be968 req-1b856b5b-3580-4983-acac-9a3b4973ab3f service nova] Creating event network-vif-plugged:8cfcaca2-cc80-404e-987d-6c3b2b9ebc17 for instance 6a056ae7-62ac-4da2-997a-b4798877ce09 on hv-cinder-85535 Aug 31 11:16:32.477505 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-5f4712b0-220a-40ce-a6c5-00e87e2be968 req-1b856b5b-3580-4983-acac-9a3b4973ab3f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135308 Aug 31 11:16:32.478338 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 497/1066] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:16:33.371297 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-a287ce9b-5e6a-4f72-a9d4-f8398a30989c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:33.371946 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-a287ce9b-5e6a-4f72-a9d4-f8398a30989c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:33.379143 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a287ce9b-5e6a-4f72-a9d4-f8398a30989c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:33.379795 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a287ce9b-5e6a-4f72-a9d4-f8398a30989c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:33.380295 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a287ce9b-5e6a-4f72-a9d4-f8398a30989c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:33.381022 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a287ce9b-5e6a-4f72-a9d4-f8398a30989c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:33.381485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a287ce9b-5e6a-4f72-a9d4-f8398a30989c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:33.381914 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-a287ce9b-5e6a-4f72-a9d4-f8398a30989c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:33.407628 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-10c48ecf-9d19-48af-a3ab-afb0b6f05fcf tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:33.408804 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-10c48ecf-9d19-48af-a3ab-afb0b6f05fcf tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:33.420399 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10c48ecf-9d19-48af-a3ab-afb0b6f05fcf tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:33.421199 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10c48ecf-9d19-48af-a3ab-afb0b6f05fcf tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:33.421986 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10c48ecf-9d19-48af-a3ab-afb0b6f05fcf tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:33.423308 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10c48ecf-9d19-48af-a3ab-afb0b6f05fcf tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:33.424161 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10c48ecf-9d19-48af-a3ab-afb0b6f05fcf tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:33.424892 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10c48ecf-9d19-48af-a3ab-afb0b6f05fcf tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:33.555790 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-a287ce9b-5e6a-4f72-a9d4-f8398a30989c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:33.564750 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-a287ce9b-5e6a-4f72-a9d4-f8398a30989c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1318 microversion: 2.1 time: 0.197329 Aug 31 11:16:33.565366 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 570/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:33 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:33.636489 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-10c48ecf-9d19-48af-a3ab-afb0b6f05fcf tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:33.646422 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-10c48ecf-9d19-48af-a3ab-afb0b6f05fcf tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.247673 Aug 31 11:16:33.646987 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 498/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:33 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:34.596823 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-06aa76ce-fb50-4fba-b400-13593e932ff7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:34.598431 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-06aa76ce-fb50-4fba-b400-13593e932ff7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:34.607699 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-06aa76ce-fb50-4fba-b400-13593e932ff7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:34.608220 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-06aa76ce-fb50-4fba-b400-13593e932ff7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:34.608661 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-06aa76ce-fb50-4fba-b400-13593e932ff7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:34.609397 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-06aa76ce-fb50-4fba-b400-13593e932ff7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:34.609866 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-06aa76ce-fb50-4fba-b400-13593e932ff7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:34.610294 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-06aa76ce-fb50-4fba-b400-13593e932ff7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:34.670195 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-70f9e510-e985-4d5b-8f7f-571453c8c71d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:34.671116 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-70f9e510-e985-4d5b-8f7f-571453c8c71d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:34.680958 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-70f9e510-e985-4d5b-8f7f-571453c8c71d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:34.681655 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-70f9e510-e985-4d5b-8f7f-571453c8c71d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:34.682242 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-70f9e510-e985-4d5b-8f7f-571453c8c71d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:34.683293 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-70f9e510-e985-4d5b-8f7f-571453c8c71d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:34.683925 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-70f9e510-e985-4d5b-8f7f-571453c8c71d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:34.684545 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-70f9e510-e985-4d5b-8f7f-571453c8c71d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:34.778196 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-06aa76ce-fb50-4fba-b400-13593e932ff7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:34.792579 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-06aa76ce-fb50-4fba-b400-13593e932ff7 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1505 microversion: 2.1 time: 0.202778 Aug 31 11:16:34.793430 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 571/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:34 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:34.815347 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-162196e8-7ff3-4ae9-bf49-a1fa941ef759 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c603b1e9-36c3-4bc1-9bec-efb58c8bdd61", "device": "/dev/sdb"}} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:16:34.819049 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-162196e8-7ff3-4ae9-bf49-a1fa941ef759 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:34.826163 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-162196e8-7ff3-4ae9-bf49-a1fa941ef759 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:34.826647 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-162196e8-7ff3-4ae9-bf49-a1fa941ef759 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:34.827089 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-162196e8-7ff3-4ae9-bf49-a1fa941ef759 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:34.827805 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-162196e8-7ff3-4ae9-bf49-a1fa941ef759 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:34.828290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-162196e8-7ff3-4ae9-bf49-a1fa941ef759 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:34.828714 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-162196e8-7ff3-4ae9-bf49-a1fa941ef759 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:34.908928 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-70f9e510-e985-4d5b-8f7f-571453c8c71d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:34.924165 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-70f9e510-e985-4d5b-8f7f-571453c8c71d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.260347 Aug 31 11:16:34.925258 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 499/1070] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:34 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:16:35.100950 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:35.124618 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-162196e8-7ff3-4ae9-bf49-a1fa941ef759 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "POST /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313274 Aug 31 11:16:35.125236 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 572/1071] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 11:16:34 2022] POST /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:16:35.946741 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-2344c89d-eadf-4aee-a90a-8ef6a62f57d6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:35.947533 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-2344c89d-eadf-4aee-a90a-8ef6a62f57d6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:35.955298 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2344c89d-eadf-4aee-a90a-8ef6a62f57d6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:35.955963 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2344c89d-eadf-4aee-a90a-8ef6a62f57d6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:35.956413 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2344c89d-eadf-4aee-a90a-8ef6a62f57d6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:35.957752 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2344c89d-eadf-4aee-a90a-8ef6a62f57d6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:35.958280 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2344c89d-eadf-4aee-a90a-8ef6a62f57d6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:35.958753 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-2344c89d-eadf-4aee-a90a-8ef6a62f57d6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:36.130401 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-2344c89d-eadf-4aee-a90a-8ef6a62f57d6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:36.147190 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-2344c89d-eadf-4aee-a90a-8ef6a62f57d6 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.204412 Aug 31 11:16:36.148137 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 500/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:35 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:37.173707 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-f1d8fcb2-d3bb-4d1b-8821-d6a25a389a24 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:37.174815 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-f1d8fcb2-d3bb-4d1b-8821-d6a25a389a24 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:37.182445 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f1d8fcb2-d3bb-4d1b-8821-d6a25a389a24 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:37.183116 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f1d8fcb2-d3bb-4d1b-8821-d6a25a389a24 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:37.183655 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f1d8fcb2-d3bb-4d1b-8821-d6a25a389a24 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:37.184541 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f1d8fcb2-d3bb-4d1b-8821-d6a25a389a24 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:37.185119 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f1d8fcb2-d3bb-4d1b-8821-d6a25a389a24 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:37.185655 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-f1d8fcb2-d3bb-4d1b-8821-d6a25a389a24 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:37.338326 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-f1d8fcb2-d3bb-4d1b-8821-d6a25a389a24 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:37.348641 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-f1d8fcb2-d3bb-4d1b-8821-d6a25a389a24 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.180002 Aug 31 11:16:37.349237 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 573/1073] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:37 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:16:38.372887 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-1550f1c9-92dd-479e-964b-9427c77707e4 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:38.373675 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-1550f1c9-92dd-479e-964b-9427c77707e4 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:38.376117 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=2 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:38.376811 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell0:SELECT=8 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:38.377570 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:38.385598 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1550f1c9-92dd-479e-964b-9427c77707e4 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:38.386190 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1550f1c9-92dd-479e-964b-9427c77707e4 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:38.386638 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1550f1c9-92dd-479e-964b-9427c77707e4 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:38.387363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1550f1c9-92dd-479e-964b-9427c77707e4 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:38.387826 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1550f1c9-92dd-479e-964b-9427c77707e4 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:38.388295 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-1550f1c9-92dd-479e-964b-9427c77707e4 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:38.582108 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-1550f1c9-92dd-479e-964b-9427c77707e4 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:38.591254 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-1550f1c9-92dd-479e-964b-9427c77707e4 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.222216 Aug 31 11:16:38.591855 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 501/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:38 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:16:39.613715 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9659fc4b-e21a-48a4-8ce9-dc0055a58efd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:39.614661 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9659fc4b-e21a-48a4-8ce9-dc0055a58efd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:39.617123 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell0:SELECT=8 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:39.617827 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:39.624634 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9659fc4b-e21a-48a4-8ce9-dc0055a58efd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:39.625134 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9659fc4b-e21a-48a4-8ce9-dc0055a58efd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:39.625572 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9659fc4b-e21a-48a4-8ce9-dc0055a58efd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:39.626291 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9659fc4b-e21a-48a4-8ce9-dc0055a58efd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:39.626749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9659fc4b-e21a-48a4-8ce9-dc0055a58efd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:39.627176 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9659fc4b-e21a-48a4-8ce9-dc0055a58efd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:39.788954 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9659fc4b-e21a-48a4-8ce9-dc0055a58efd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:39.796953 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9659fc4b-e21a-48a4-8ce9-dc0055a58efd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.187641 Aug 31 11:16:39.797551 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 574/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:39 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:40.838212 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-327603f8-275d-459f-b3b9-a09da4b4bedd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:40.839286 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-327603f8-275d-459f-b3b9-a09da4b4bedd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:40.851525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-327603f8-275d-459f-b3b9-a09da4b4bedd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:40.852788 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-327603f8-275d-459f-b3b9-a09da4b4bedd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:40.853233 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-327603f8-275d-459f-b3b9-a09da4b4bedd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:40.854100 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-327603f8-275d-459f-b3b9-a09da4b4bedd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:40.854681 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-327603f8-275d-459f-b3b9-a09da4b4bedd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:40.855358 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-327603f8-275d-459f-b3b9-a09da4b4bedd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:41.051547 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-327603f8-275d-459f-b3b9-a09da4b4bedd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:41.060652 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-327603f8-275d-459f-b3b9-a09da4b4bedd tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.231040 Aug 31 11:16:41.061250 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 502/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:40 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:42.083521 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d664c663-addf-4793-9d1b-c90ba59be006 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:42.084469 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d664c663-addf-4793-9d1b-c90ba59be006 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:42.094659 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d664c663-addf-4793-9d1b-c90ba59be006 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:42.095537 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d664c663-addf-4793-9d1b-c90ba59be006 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:42.096412 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d664c663-addf-4793-9d1b-c90ba59be006 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:42.097728 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d664c663-addf-4793-9d1b-c90ba59be006 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:42.098763 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d664c663-addf-4793-9d1b-c90ba59be006 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:42.099554 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d664c663-addf-4793-9d1b-c90ba59be006 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:42.227068 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-867b5d0a-f7e7-44bd-a723-81c234b0d812 req-1fc63eb9-df26-4ec8-8770-9d1ed27f92b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd0493b-103b-4ecb-ae59-72e5d411599d", "name": "network-vif-plugged", "status": "completed", "tag": "bbc26ac4-8854-4a58-bd94-d4099fa4cb35"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:16:42.250199 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-867b5d0a-f7e7-44bd-a723-81c234b0d812 req-1fc63eb9-df26-4ec8-8770-9d1ed27f92b6 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:42.251747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-867b5d0a-f7e7-44bd-a723-81c234b0d812 req-1fc63eb9-df26-4ec8-8770-9d1ed27f92b6 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:42.252947 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-867b5d0a-f7e7-44bd-a723-81c234b0d812 req-1fc63eb9-df26-4ec8-8770-9d1ed27f92b6 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:42.278553 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-867b5d0a-f7e7-44bd-a723-81c234b0d812 req-1fc63eb9-df26-4ec8-8770-9d1ed27f92b6 service nova] Creating event network-vif-plugged:bbc26ac4-8854-4a58-bd94-d4099fa4cb35 for instance 5cd0493b-103b-4ecb-ae59-72e5d411599d on hv-cinder-85535 Aug 31 11:16:42.282832 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d664c663-addf-4793-9d1b-c90ba59be006 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:42.285723 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-867b5d0a-f7e7-44bd-a723-81c234b0d812 req-1fc63eb9-df26-4ec8-8770-9d1ed27f92b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067856 Aug 31 11:16:42.286605 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 503/1077] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:16:42.294584 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d664c663-addf-4793-9d1b-c90ba59be006 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.215291 Aug 31 11:16:42.295450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 575/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:42 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:16:43.317722 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-9f35b626-26e1-4db7-96e6-dbad4302430b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:43.318439 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-9f35b626-26e1-4db7-96e6-dbad4302430b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:43.325211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9f35b626-26e1-4db7-96e6-dbad4302430b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:43.325709 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9f35b626-26e1-4db7-96e6-dbad4302430b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:43.326153 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9f35b626-26e1-4db7-96e6-dbad4302430b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:43.326871 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9f35b626-26e1-4db7-96e6-dbad4302430b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:43.327327 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9f35b626-26e1-4db7-96e6-dbad4302430b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:43.327756 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-9f35b626-26e1-4db7-96e6-dbad4302430b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:43.508122 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-9f35b626-26e1-4db7-96e6-dbad4302430b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:43.521231 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-9f35b626-26e1-4db7-96e6-dbad4302430b tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.208148 Aug 31 11:16:43.522045 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 504/1079] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:43 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:44.552758 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b059921b-8117-4601-8924-99cd02933fef tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:44.553695 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b059921b-8117-4601-8924-99cd02933fef tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:44.560347 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b059921b-8117-4601-8924-99cd02933fef tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:44.560842 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b059921b-8117-4601-8924-99cd02933fef tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:44.561284 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b059921b-8117-4601-8924-99cd02933fef tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:44.562002 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b059921b-8117-4601-8924-99cd02933fef tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:44.562458 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b059921b-8117-4601-8924-99cd02933fef tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:44.562886 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b059921b-8117-4601-8924-99cd02933fef tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:44.724520 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b059921b-8117-4601-8924-99cd02933fef tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:44.733149 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b059921b-8117-4601-8924-99cd02933fef tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.185730 Aug 31 11:16:44.733754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 576/1080] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:44 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:45.756683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-376e56f6-dafc-4049-8401-9209b40c5471 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:45.757288 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-376e56f6-dafc-4049-8401-9209b40c5471 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:45.764194 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-376e56f6-dafc-4049-8401-9209b40c5471 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:45.764684 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-376e56f6-dafc-4049-8401-9209b40c5471 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:45.765120 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-376e56f6-dafc-4049-8401-9209b40c5471 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:45.765847 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-376e56f6-dafc-4049-8401-9209b40c5471 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:45.766303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-376e56f6-dafc-4049-8401-9209b40c5471 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:45.766735 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-376e56f6-dafc-4049-8401-9209b40c5471 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:45.924931 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-376e56f6-dafc-4049-8401-9209b40c5471 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:45.940080 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-376e56f6-dafc-4049-8401-9209b40c5471 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1265 microversion: 2.1 time: 0.188547 Aug 31 11:16:45.941847 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 505/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:45 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:46.962685 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-4c339779-9ab3-4034-b479-407fc3f0fa65 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:46.963318 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-4c339779-9ab3-4034-b479-407fc3f0fa65 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:46.973908 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c339779-9ab3-4034-b479-407fc3f0fa65 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:46.974831 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c339779-9ab3-4034-b479-407fc3f0fa65 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:46.975668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c339779-9ab3-4034-b479-407fc3f0fa65 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:46.976991 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c339779-9ab3-4034-b479-407fc3f0fa65 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:46.977827 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c339779-9ab3-4034-b479-407fc3f0fa65 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:46.978615 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-4c339779-9ab3-4034-b479-407fc3f0fa65 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:47.162101 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-4c339779-9ab3-4034-b479-407fc3f0fa65 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:47.170760 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-4c339779-9ab3-4034-b479-407fc3f0fa65 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1451 microversion: 2.1 time: 0.212196 Aug 31 11:16:47.171506 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 577/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:46 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1451 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:47.192230 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-10e9cfa6-3b7f-413a-a88e-fe04c25380e0 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:47.192820 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-10e9cfa6-3b7f-413a-a88e-fe04c25380e0 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:47.199595 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10e9cfa6-3b7f-413a-a88e-fe04c25380e0 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:47.200122 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10e9cfa6-3b7f-413a-a88e-fe04c25380e0 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:47.200563 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10e9cfa6-3b7f-413a-a88e-fe04c25380e0 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:47.201293 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10e9cfa6-3b7f-413a-a88e-fe04c25380e0 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:47.201748 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10e9cfa6-3b7f-413a-a88e-fe04c25380e0 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:47.202169 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-10e9cfa6-3b7f-413a-a88e-fe04c25380e0 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:47.368596 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-10e9cfa6-3b7f-413a-a88e-fe04c25380e0 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:47.377076 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-10e9cfa6-3b7f-413a-a88e-fe04c25380e0 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1451 microversion: 2.1 time: 0.188725 Aug 31 11:16:47.377672 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 506/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:47 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:49.251394 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [req-198906ac-3b5d-43bf-b9f0-da9fb56c8d0d req-f320f815-7b72-4a9c-ab59-348dbab430f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd0493b-103b-4ecb-ae59-72e5d411599d", "tag": "bbc26ac4-8854-4a58-bd94-d4099fa4cb35"}]} {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:16:49.267353 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-198906ac-3b5d-43bf-b9f0-da9fb56c8d0d req-f320f815-7b72-4a9c-ab59-348dbab430f8 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:49.268368 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-198906ac-3b5d-43bf-b9f0-da9fb56c8d0d req-f320f815-7b72-4a9c-ab59-348dbab430f8 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:49.269749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [req-198906ac-3b5d-43bf-b9f0-da9fb56c8d0d req-f320f815-7b72-4a9c-ab59-348dbab430f8 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:49.286908 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.compute.server_external_events [req-198906ac-3b5d-43bf-b9f0-da9fb56c8d0d req-f320f815-7b72-4a9c-ab59-348dbab430f8 service nova] Creating event network-changed:bbc26ac4-8854-4a58-bd94-d4099fa4cb35 for instance 5cd0493b-103b-4ecb-ae59-72e5d411599d on hv-cinder-85535 Aug 31 11:16:49.297754 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [req-198906ac-3b5d-43bf-b9f0-da9fb56c8d0d req-f320f815-7b72-4a9c-ab59-348dbab430f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048588 Aug 31 11:16:49.305328 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 578/1084] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:16:53.919254 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-618976f6-f8cb-4dc3-8498-119cfadce895 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:53.919905 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-618976f6-f8cb-4dc3-8498-119cfadce895 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:53.928095 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-618976f6-f8cb-4dc3-8498-119cfadce895 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:53.928589 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-618976f6-f8cb-4dc3-8498-119cfadce895 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:53.929028 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-618976f6-f8cb-4dc3-8498-119cfadce895 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:53.929747 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-618976f6-f8cb-4dc3-8498-119cfadce895 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:53.930205 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-618976f6-f8cb-4dc3-8498-119cfadce895 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:53.930639 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-618976f6-f8cb-4dc3-8498-119cfadce895 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:53.933862 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=93 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:54.025713 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.objects.instance [None req-618976f6-f8cb-4dc3-8498-119cfadce895 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lazy-loading 'services' on Instance uuid 6a056ae7-62ac-4da2-997a-b4798877ce09 {{(pid=120655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:16:54.108236 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-618976f6-f8cb-4dc3-8498-119cfadce895 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09/os-volume_attachments/c603b1e9-36c3-4bc1-9bec-efb58c8bdd61" status: 202 len: 0 microversion: 2.1 time: 0.192922 Aug 31 11:16:54.109153 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 507/1085] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 11:16:53 2022] DELETE /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09/os-volume_attachments/c603b1e9-36c3-4bc1-9bec-efb58c8bdd61 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:16:55.246474 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-ee21342a-f2cb-424f-bbd4-194dce487aa6 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:55.247278 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ee21342a-f2cb-424f-bbd4-194dce487aa6 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:55.255907 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ee21342a-f2cb-424f-bbd4-194dce487aa6 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:55.256512 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ee21342a-f2cb-424f-bbd4-194dce487aa6 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:55.257094 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ee21342a-f2cb-424f-bbd4-194dce487aa6 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:55.257920 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ee21342a-f2cb-424f-bbd4-194dce487aa6 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:55.258416 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ee21342a-f2cb-424f-bbd4-194dce487aa6 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:55.258959 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-ee21342a-f2cb-424f-bbd4-194dce487aa6 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:55.287575 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-ee21342a-f2cb-424f-bbd4-194dce487aa6 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:16:55.385391 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-ee21342a-f2cb-424f-bbd4-194dce487aa6 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 204 len: 0 microversion: 2.1 time: 0.143072 Aug 31 11:16:55.386161 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 579/1086] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:16:55 2022] DELETE /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:16:55.397277 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-b92dbbf1-5966-490c-a6b0-4a41539675f5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:55.398063 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-b92dbbf1-5966-490c-a6b0-4a41539675f5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:55.405477 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b92dbbf1-5966-490c-a6b0-4a41539675f5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:55.406015 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b92dbbf1-5966-490c-a6b0-4a41539675f5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:55.406525 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b92dbbf1-5966-490c-a6b0-4a41539675f5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:55.407277 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b92dbbf1-5966-490c-a6b0-4a41539675f5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:55.407852 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b92dbbf1-5966-490c-a6b0-4a41539675f5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:55.408402 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-b92dbbf1-5966-490c-a6b0-4a41539675f5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:55.574451 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-b92dbbf1-5966-490c-a6b0-4a41539675f5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:55.583593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-b92dbbf1-5966-490c-a6b0-4a41539675f5 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1511 microversion: 2.1 time: 0.192148 Aug 31 11:16:55.584235 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 508/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:55 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:56.607670 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d5b11a55-21b7-4e11-90e8-dcdcfdd7aaf2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:56.608492 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d5b11a55-21b7-4e11-90e8-dcdcfdd7aaf2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:56.616665 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d5b11a55-21b7-4e11-90e8-dcdcfdd7aaf2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:56.617240 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d5b11a55-21b7-4e11-90e8-dcdcfdd7aaf2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:56.617903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d5b11a55-21b7-4e11-90e8-dcdcfdd7aaf2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:56.619166 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d5b11a55-21b7-4e11-90e8-dcdcfdd7aaf2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:56.620032 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d5b11a55-21b7-4e11-90e8-dcdcfdd7aaf2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:56.620729 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d5b11a55-21b7-4e11-90e8-dcdcfdd7aaf2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:56.777336 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-d5b11a55-21b7-4e11-90e8-dcdcfdd7aaf2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:56.789435 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d5b11a55-21b7-4e11-90e8-dcdcfdd7aaf2 tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1511 microversion: 2.1 time: 0.185189 Aug 31 11:16:56.789435 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 580/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:56 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:16:57.576518 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-558debb2-cc8b-433b-b764-b63695012190 req-f34bb534-af59-4cab-a373-f14d0e63d087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a056ae7-62ac-4da2-997a-b4798877ce09", "name": "network-vif-deleted", "tag": "8cfcaca2-cc80-404e-987d-6c3b2b9ebc17"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:16:57.596848 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-558debb2-cc8b-433b-b764-b63695012190 req-f34bb534-af59-4cab-a373-f14d0e63d087 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:57.598027 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-558debb2-cc8b-433b-b764-b63695012190 req-f34bb534-af59-4cab-a373-f14d0e63d087 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:57.598608 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-558debb2-cc8b-433b-b764-b63695012190 req-f34bb534-af59-4cab-a373-f14d0e63d087 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:57.618173 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-558debb2-cc8b-433b-b764-b63695012190 req-f34bb534-af59-4cab-a373-f14d0e63d087 service nova] Creating event network-vif-deleted:8cfcaca2-cc80-404e-987d-6c3b2b9ebc17 for instance 6a056ae7-62ac-4da2-997a-b4798877ce09 on hv-cinder-85535 Aug 31 11:16:57.623867 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-558debb2-cc8b-433b-b764-b63695012190 req-f34bb534-af59-4cab-a373-f14d0e63d087 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054851 Aug 31 11:16:57.624580 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 509/1089] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:16:57.814073 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:57.815725 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:57.826196 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:57.827903 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:57.828565 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:57.829757 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:57.830527 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:57.831463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:57.868235 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:57.868749 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:57.869184 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:57.869632 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lazy-loading 'fault' on Instance uuid 6a056ae7-62ac-4da2-997a-b4798877ce09 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:16:57.913154 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aff6cc28ab4118bb334d7249697e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc761089b5740ecb88c71ff97f3f270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:16:57.921366 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-439e9411-76e0-49fe-b246-552e40fa2b4e tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 200 len: 1308 microversion: 2.1 time: 0.113972 Aug 31 11:16:57.921964 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 581/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:57 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:16:58.945104 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-322bb8a8-8c2b-4a55-88d2-840496b89c4c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:16:58.945983 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-322bb8a8-8c2b-4a55-88d2-840496b89c4c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] [instance: 6a056ae7-62ac-4da2-997a-b4798877ce09] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:16:58.953132 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-322bb8a8-8c2b-4a55-88d2-840496b89c4c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:58.953629 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-322bb8a8-8c2b-4a55-88d2-840496b89c4c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:58.954070 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-322bb8a8-8c2b-4a55-88d2-840496b89c4c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:58.954825 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-322bb8a8-8c2b-4a55-88d2-840496b89c4c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:16:58.955282 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-322bb8a8-8c2b-4a55-88d2-840496b89c4c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:16:58.956368 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-322bb8a8-8c2b-4a55-88d2-840496b89c4c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:16:58.972034 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-322bb8a8-8c2b-4a55-88d2-840496b89c4c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] HTTP exception thrown: Instance 6a056ae7-62ac-4da2-997a-b4798877ce09 could not be found. Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-322bb8a8-8c2b-4a55-88d2-840496b89c4c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Request method failure captured: Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 HTTP/1.1 Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0LF_5ivNUcq01AvZwQTHN1tY_PAPHkvByVl1VoeMejChAi2hGJUnMa1YfBhzOczlkJ2IGBqaJU9Kr6FXo8vPHzLJIDxUx2bC6qTGn8ZazBagoBdJfq0Nn43mI7lnKPqzNGv4YWrjHa011Xy5Dhcp_q75WXFVDnKRnxX8OnF9DNan5g Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: 1fc761089b5740ecb88c71ff97f3f270 Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1261193041 Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:16:58.973961 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:16:58.976064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1fc761089b5740ecb88c71ff97f3f270"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1fc761089b5740ecb88c71ff97f3f270"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fc761089b5740ecb88c71ff97f3f270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fc761089b5740ecb88c71ff97f3f270"}]}] Aug 31 11:16:58.976064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-VolumesSnapshotTestJSON-1261193041 Aug 31 11:16:58.976064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: 1fc761089b5740ecb88c71ff97f3f270 Aug 31 11:16:58.976064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1261193041 Aug 31 11:16:58.976064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-VolumesSnapshotTestJSON-1261193041-project Aug 31 11:16:58.976064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:16:58.976064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:16:58.976064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 28aff6cc28ab4118bb334d7249697e9f Aug 31 11:16:58.976064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-VolumesSnapshotTestJSON-1261193041-project Aug 31 11:16:58.976064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:16:58.976064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 6a056ae7-62ac-4da2-997a-b4798877ce09 could not be found. Aug 31 11:16:58.976064 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '6a056ae7-62ac-4da2-997a-b4798877ce09'} Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a056ae7-62ac-4da2-997a-b4798877ce09 could not be found. Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:16:58.977348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a056ae7-62ac-4da2-997a-b4798877ce09 could not be found. Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a056ae7-62ac-4da2-997a-b4798877ce09 could not be found. Aug 31 11:16:58.979683 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:16:58.981447 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-322bb8a8-8c2b-4a55-88d2-840496b89c4c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] Returning 404 to user: Instance 6a056ae7-62ac-4da2-997a-b4798877ce09 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:16:58.981447 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-322bb8a8-8c2b-4a55-88d2-840496b89c4c tempest-VolumesSnapshotTestJSON-1261193041 tempest-VolumesSnapshotTestJSON-1261193041-project] 10.222.0.20 "GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09" status: 404 len: 111 microversion: 2.1 time: 0.036005 Aug 31 11:16:58.981447 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 510/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:16:58 2022] GET /compute/v2.1/servers/6a056ae7-62ac-4da2-997a-b4798877ce09 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:18:30.216080 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:18:30.217922 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_api:SELECT=19 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:18:30.218703 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG dbcounter [-] [120655] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=120655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:18:30.219544 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG dbcounter [-] [120654] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:18:30.224123 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-dc698fe2-bd20-4633-8848-e5a0c7ee4c61 req-0c20ba7d-4695-4916-8cda-8763d72d68eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd0493b-103b-4ecb-ae59-72e5d411599d", "tag": "bbc26ac4-8854-4a58-bd94-d4099fa4cb35"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:18:30.227747 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-d6391b0c-11d6-4d49-84b6-96ecf539c208 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:30.228469 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d6391b0c-11d6-4d49-84b6-96ecf539c208 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:18:30.236955 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-dc698fe2-bd20-4633-8848-e5a0c7ee4c61 req-0c20ba7d-4695-4916-8cda-8763d72d68eb service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:30.237478 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-dc698fe2-bd20-4633-8848-e5a0c7ee4c61 req-0c20ba7d-4695-4916-8cda-8763d72d68eb service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:30.237813 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-dc698fe2-bd20-4633-8848-e5a0c7ee4c61 req-0c20ba7d-4695-4916-8cda-8763d72d68eb service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:30.241437 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6391b0c-11d6-4d49-84b6-96ecf539c208 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:30.242905 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6391b0c-11d6-4d49-84b6-96ecf539c208 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:30.243872 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6391b0c-11d6-4d49-84b6-96ecf539c208 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:30.245156 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6391b0c-11d6-4d49-84b6-96ecf539c208 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:30.246267 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6391b0c-11d6-4d49-84b6-96ecf539c208 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:30.247173 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-d6391b0c-11d6-4d49-84b6-96ecf539c208 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:30.251696 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-dc698fe2-bd20-4633-8848-e5a0c7ee4c61 req-0c20ba7d-4695-4916-8cda-8763d72d68eb service nova] Creating event network-changed:bbc26ac4-8854-4a58-bd94-d4099fa4cb35 for instance 5cd0493b-103b-4ecb-ae59-72e5d411599d on hv-cinder-85535 Aug 31 11:18:30.257054 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-dc698fe2-bd20-4633-8848-e5a0c7ee4c61 req-0c20ba7d-4695-4916-8cda-8763d72d68eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041596 Aug 31 11:18:30.260709 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 511/1092] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:18:30.289528 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-d6391b0c-11d6-4d49-84b6-96ecf539c208 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:18:30.425909 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-d6391b0c-11d6-4d49-84b6-96ecf539c208 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 204 len: 0 microversion: 2.1 time: 0.211609 Aug 31 11:18:30.427395 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 582/1093] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:18:30 2022] DELETE /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:18:30.443058 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-3b047272-9a1a-4485-b1c9-604114bfd3b9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:30.444454 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-3b047272-9a1a-4485-b1c9-604114bfd3b9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:18:30.456139 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3b047272-9a1a-4485-b1c9-604114bfd3b9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:30.457356 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3b047272-9a1a-4485-b1c9-604114bfd3b9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:30.458160 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3b047272-9a1a-4485-b1c9-604114bfd3b9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:30.459459 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3b047272-9a1a-4485-b1c9-604114bfd3b9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:30.460505 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3b047272-9a1a-4485-b1c9-604114bfd3b9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:30.461565 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-3b047272-9a1a-4485-b1c9-604114bfd3b9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:30.652626 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-3b047272-9a1a-4485-b1c9-604114bfd3b9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:18:30.661968 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-3b047272-9a1a-4485-b1c9-604114bfd3b9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1575 microversion: 2.1 time: 0.228865 Aug 31 11:18:30.662675 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 512/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:18:30 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:18:31.692423 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-66f02a0a-1c04-4798-959a-00b610539fce tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:31.693369 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-66f02a0a-1c04-4798-959a-00b610539fce tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:18:31.702220 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66f02a0a-1c04-4798-959a-00b610539fce tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:31.702902 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66f02a0a-1c04-4798-959a-00b610539fce tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:31.703438 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66f02a0a-1c04-4798-959a-00b610539fce tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:31.704377 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66f02a0a-1c04-4798-959a-00b610539fce tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:31.704933 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66f02a0a-1c04-4798-959a-00b610539fce tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:31.705507 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-66f02a0a-1c04-4798-959a-00b610539fce tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:31.920521 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-66f02a0a-1c04-4798-959a-00b610539fce tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:18:31.931995 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-66f02a0a-1c04-4798-959a-00b610539fce tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1575 microversion: 2.1 time: 0.244667 Aug 31 11:18:31.932869 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 583/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:18:31 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:18:32.631695 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-99918939-2ec6-4b05-bb4a-3a0b8e609a95 req-938a3365-511b-4975-a51e-b3be89ab29a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd0493b-103b-4ecb-ae59-72e5d411599d", "name": "network-vif-deleted", "tag": "bbc26ac4-8854-4a58-bd94-d4099fa4cb35"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:18:32.644586 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-99918939-2ec6-4b05-bb4a-3a0b8e609a95 req-938a3365-511b-4975-a51e-b3be89ab29a1 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:32.645386 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-99918939-2ec6-4b05-bb4a-3a0b8e609a95 req-938a3365-511b-4975-a51e-b3be89ab29a1 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:32.645993 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-99918939-2ec6-4b05-bb4a-3a0b8e609a95 req-938a3365-511b-4975-a51e-b3be89ab29a1 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:32.661104 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-99918939-2ec6-4b05-bb4a-3a0b8e609a95 req-938a3365-511b-4975-a51e-b3be89ab29a1 service nova] Creating event network-vif-deleted:bbc26ac4-8854-4a58-bd94-d4099fa4cb35 for instance 5cd0493b-103b-4ecb-ae59-72e5d411599d on hv-cinder-85535 Aug 31 11:18:32.667757 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-99918939-2ec6-4b05-bb4a-3a0b8e609a95 req-938a3365-511b-4975-a51e-b3be89ab29a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041513 Aug 31 11:18:32.668674 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 513/1096] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:18:32.959151 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:32.960450 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:18:32.973057 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:32.973821 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:32.974485 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:32.975353 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:32.975956 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:32.976595 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:33.024884 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:33.025704 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:33.026220 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:33.026752 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lazy-loading 'fault' on Instance uuid 5cd0493b-103b-4ecb-ae59-72e5d411599d {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:18:33.098141 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:18:33.109269 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9ac22879-2d89-4d01-8e4c-5f0b8bcb58c1 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 200 len: 1230 microversion: 2.1 time: 0.156595 Aug 31 11:18:33.109979 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 584/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:18:32 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 1230 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:18:34.146794 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d5246a02-6d5a-46c8-9cad-ea3caaa5220d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:34.149506 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-d5246a02-6d5a-46c8-9cad-ea3caaa5220d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 5cd0493b-103b-4ecb-ae59-72e5d411599d] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:18:34.156682 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5246a02-6d5a-46c8-9cad-ea3caaa5220d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:34.157335 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5246a02-6d5a-46c8-9cad-ea3caaa5220d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:34.157839 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5246a02-6d5a-46c8-9cad-ea3caaa5220d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:34.158725 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5246a02-6d5a-46c8-9cad-ea3caaa5220d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:34.159315 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5246a02-6d5a-46c8-9cad-ea3caaa5220d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:34.159760 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-d5246a02-6d5a-46c8-9cad-ea3caaa5220d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:34.177732 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-d5246a02-6d5a-46c8-9cad-ea3caaa5220d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] HTTP exception thrown: Instance 5cd0493b-103b-4ecb-ae59-72e5d411599d could not be found. Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d5246a02-6d5a-46c8-9cad-ea3caaa5220d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Request method failure captured: Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d HTTP/1.1 Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0G_5CnX0bgu49qBKEATrPjG5ij1O-g_F-tJeS3zcQuveUNLmpeNedxKK-hb2CtQauSFh7J_yZUA84PLFjvGSp83HfmZq41rhTg89kUz9RglDEWJhTTgATyWoUcj7nI28YGWmyXan6KrHqcZ7FwaN-TfvwTMYRnoebG29g96CCD25E0 Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: da5b36cb688f49e1bf1cf75a108858fa Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:18:34.179441 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:18:34.182285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da5b36cb688f49e1bf1cf75a108858fa"}]}] Aug 31 11:18:34.182285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:18:34.182285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: da5b36cb688f49e1bf1cf75a108858fa Aug 31 11:18:34.182285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:18:34.182285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-TestVolumeBootPattern-1688397389-project Aug 31 11:18:34.182285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:18:34.182285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:18:34.182285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 16696c34de254f3babf538c879f2ce49 Aug 31 11:18:34.182285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-TestVolumeBootPattern-1688397389-project Aug 31 11:18:34.182285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:18:34.182285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 5cd0493b-103b-4ecb-ae59-72e5d411599d could not be found. Aug 31 11:18:34.182285 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '5cd0493b-103b-4ecb-ae59-72e5d411599d'} Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cd0493b-103b-4ecb-ae59-72e5d411599d could not be found. Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:18:34.183874 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cd0493b-103b-4ecb-ae59-72e5d411599d could not be found. Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cd0493b-103b-4ecb-ae59-72e5d411599d could not be found. Aug 31 11:18:34.186673 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:34.189323 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-d5246a02-6d5a-46c8-9cad-ea3caaa5220d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Returning 404 to user: Instance 5cd0493b-103b-4ecb-ae59-72e5d411599d could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:18:34.189323 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-d5246a02-6d5a-46c8-9cad-ea3caaa5220d tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d" status: 404 len: 111 microversion: 2.1 time: 0.040199 Aug 31 11:18:34.189323 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 514/1098] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:18:34 2022] GET /compute/v2.1/servers/5cd0493b-103b-4ecb-ae59-72e5d411599d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:18:37.734881 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-05a0d46a-5f4d-4d46-971c-b02fd408a4c2 req-6cfbee4d-b4e2-4f05-8ab1-f965707a257d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b0e5fc-405a-4d4d-b686-9430787260d2", "tag": "54ffd0ba-c10d-41e7-af2c-adcc9d425393"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:18:37.737780 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e0e58c82-144c-41d7-9aaf-16df733f73fb tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:37.738855 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e0e58c82-144c-41d7-9aaf-16df733f73fb tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:18:37.746152 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-05a0d46a-5f4d-4d46-971c-b02fd408a4c2 req-6cfbee4d-b4e2-4f05-8ab1-f965707a257d service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:37.746628 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-05a0d46a-5f4d-4d46-971c-b02fd408a4c2 req-6cfbee4d-b4e2-4f05-8ab1-f965707a257d service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:37.747411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-05a0d46a-5f4d-4d46-971c-b02fd408a4c2 req-6cfbee4d-b4e2-4f05-8ab1-f965707a257d service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:37.753049 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0e58c82-144c-41d7-9aaf-16df733f73fb tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:37.754107 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0e58c82-144c-41d7-9aaf-16df733f73fb tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:37.755025 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0e58c82-144c-41d7-9aaf-16df733f73fb tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:37.757850 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0e58c82-144c-41d7-9aaf-16df733f73fb tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:37.758821 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0e58c82-144c-41d7-9aaf-16df733f73fb tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:37.759876 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-e0e58c82-144c-41d7-9aaf-16df733f73fb tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:37.760764 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-05a0d46a-5f4d-4d46-971c-b02fd408a4c2 req-6cfbee4d-b4e2-4f05-8ab1-f965707a257d service nova] Creating event network-changed:54ffd0ba-c10d-41e7-af2c-adcc9d425393 for instance 14b0e5fc-405a-4d4d-b686-9430787260d2 on hv-cinder-85535 Aug 31 11:18:37.767788 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-05a0d46a-5f4d-4d46-971c-b02fd408a4c2 req-6cfbee4d-b4e2-4f05-8ab1-f965707a257d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036724 Aug 31 11:18:37.770753 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 515/1099] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:18:37.807883 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-e0e58c82-144c-41d7-9aaf-16df733f73fb tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Going to try to terminate instance {{(pid=120654) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:18:37.926432 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e0e58c82-144c-41d7-9aaf-16df733f73fb tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 204 len: 0 microversion: 2.1 time: 0.196155 Aug 31 11:18:37.932144 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 585/1100] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:18:37 2022] DELETE /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:18:37.944814 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-ebaf584c-e3d6-402d-883c-69d5fada8122 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:37.946150 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-ebaf584c-e3d6-402d-883c-69d5fada8122 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:18:37.959373 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ebaf584c-e3d6-402d-883c-69d5fada8122 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:37.960274 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ebaf584c-e3d6-402d-883c-69d5fada8122 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:37.961069 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ebaf584c-e3d6-402d-883c-69d5fada8122 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:37.962348 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ebaf584c-e3d6-402d-883c-69d5fada8122 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:37.963196 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ebaf584c-e3d6-402d-883c-69d5fada8122 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:37.963987 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-ebaf584c-e3d6-402d-883c-69d5fada8122 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:38.152434 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.policy [None req-ebaf584c-e3d6-402d-883c-69d5fada8122 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120655) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:18:38.164073 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-ebaf584c-e3d6-402d-883c-69d5fada8122 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1576 microversion: 2.1 time: 0.229315 Aug 31 11:18:38.164845 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 516/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:18:37 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:18:39.188433 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-b5eac0db-3bf0-41e7-93bb-4d69285db965 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:39.189582 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-b5eac0db-3bf0-41e7-93bb-4d69285db965 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:18:39.197621 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5eac0db-3bf0-41e7-93bb-4d69285db965 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:39.198309 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5eac0db-3bf0-41e7-93bb-4d69285db965 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:39.198966 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5eac0db-3bf0-41e7-93bb-4d69285db965 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:39.199793 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5eac0db-3bf0-41e7-93bb-4d69285db965 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:39.201179 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5eac0db-3bf0-41e7-93bb-4d69285db965 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:39.201940 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-b5eac0db-3bf0-41e7-93bb-4d69285db965 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:39.719219 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-b5eac0db-3bf0-41e7-93bb-4d69285db965 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:18:39.733851 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-b5eac0db-3bf0-41e7-93bb-4d69285db965 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1576 microversion: 2.1 time: 0.550080 Aug 31 11:18:39.734989 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 586/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:18:39 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1576 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:18:40.186877 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [req-17910259-4d64-4d9b-9afa-e8285962bebd req-0897820e-c770-4932-922b-98e7d52263f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b0e5fc-405a-4d4d-b686-9430787260d2", "name": "network-vif-deleted", "tag": "54ffd0ba-c10d-41e7-af2c-adcc9d425393"}]} {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:18:40.208758 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-17910259-4d64-4d9b-9afa-e8285962bebd req-0897820e-c770-4932-922b-98e7d52263f7 service nova] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:40.209901 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-17910259-4d64-4d9b-9afa-e8285962bebd req-0897820e-c770-4932-922b-98e7d52263f7 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:40.210773 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [req-17910259-4d64-4d9b-9afa-e8285962bebd req-0897820e-c770-4932-922b-98e7d52263f7 service nova] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:40.236031 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.compute.server_external_events [req-17910259-4d64-4d9b-9afa-e8285962bebd req-0897820e-c770-4932-922b-98e7d52263f7 service nova] Creating event network-vif-deleted:54ffd0ba-c10d-41e7-af2c-adcc9d425393 for instance 14b0e5fc-405a-4d4d-b686-9430787260d2 on hv-cinder-85535 Aug 31 11:18:40.244380 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [req-17910259-4d64-4d9b-9afa-e8285962bebd req-0897820e-c770-4932-922b-98e7d52263f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065435 Aug 31 11:18:40.245425 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 517/1103] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 11:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:18:40.759620 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:40.760238 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:18:40.769226 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:40.769855 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:40.770298 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:40.771165 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:40.771753 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:40.772230 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:40.813253 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:40.813938 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:40.814538 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:40.815124 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.objects.instance [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lazy-loading 'fault' on Instance uuid 14b0e5fc-405a-4d4d-b686-9430787260d2 {{(pid=120654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:18:40.868967 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.policy [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16696c34de254f3babf538c879f2ce49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b36cb688f49e1bf1cf75a108858fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120654) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:18:40.888858 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-9c9cd439-e917-476a-84b0-b1acf76ac780 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 200 len: 1230 microversion: 2.1 time: 0.130826 Aug 31 11:18:40.888858 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 587/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:18:40 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 1230 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:18:41.923553 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-aeecef78-3869-488d-8669-620c816a3fff tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:41.924411 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-aeecef78-3869-488d-8669-620c816a3fff tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 14b0e5fc-405a-4d4d-b686-9430787260d2] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:18:41.934904 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aeecef78-3869-488d-8669-620c816a3fff tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:41.935778 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aeecef78-3869-488d-8669-620c816a3fff tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:41.936594 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aeecef78-3869-488d-8669-620c816a3fff tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:41.937928 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aeecef78-3869-488d-8669-620c816a3fff tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:41.938750 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aeecef78-3869-488d-8669-620c816a3fff tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:41.939522 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-aeecef78-3869-488d-8669-620c816a3fff tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:41.966303 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-aeecef78-3869-488d-8669-620c816a3fff tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] HTTP exception thrown: Instance 14b0e5fc-405a-4d4d-b686-9430787260d2 could not be found. Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-aeecef78-3869-488d-8669-620c816a3fff tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Request method failure captured: Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 HTTP/1.1 Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0G_5CnX0bgu49qBKEATrPjG5ij1O-g_F-tJeS3zcQuveUNLmpeNedxKK-hb2CtQauSFh7J_yZUA84PLFjvGSp83HfmZq41rhTg89kUz9RglDEWJhTTgATyWoUcj7nI28YGWmyXan6KrHqcZ7FwaN-TfvwTMYRnoebG29g96CCD25E0 Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: da5b36cb688f49e1bf1cf75a108858fa Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:18:41.969967 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:18:41.971661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da5b36cb688f49e1bf1cf75a108858fa"}]}] Aug 31 11:18:41.971661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:18:41.971661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: da5b36cb688f49e1bf1cf75a108858fa Aug 31 11:18:41.971661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:18:41.971661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-TestVolumeBootPattern-1688397389-project Aug 31 11:18:41.971661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:18:41.971661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:18:41.971661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 16696c34de254f3babf538c879f2ce49 Aug 31 11:18:41.971661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-TestVolumeBootPattern-1688397389-project Aug 31 11:18:41.971661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:18:41.971661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 14b0e5fc-405a-4d4d-b686-9430787260d2 could not be found. Aug 31 11:18:41.971661 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '14b0e5fc-405a-4d4d-b686-9430787260d2'} Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b0e5fc-405a-4d4d-b686-9430787260d2 could not be found. Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:18:41.972593 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b0e5fc-405a-4d4d-b686-9430787260d2 could not be found. Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b0e5fc-405a-4d4d-b686-9430787260d2 could not be found. Aug 31 11:18:41.973978 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:41.975499 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-aeecef78-3869-488d-8669-620c816a3fff tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Returning 404 to user: Instance 14b0e5fc-405a-4d4d-b686-9430787260d2 could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:18:41.975499 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-aeecef78-3869-488d-8669-620c816a3fff tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2" status: 404 len: 111 microversion: 2.1 time: 0.054243 Aug 31 11:18:41.975499 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 518/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:18:41 2022] GET /compute/v2.1/servers/14b0e5fc-405a-4d4d-b686-9430787260d2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:18:42.477498 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-70d8703b-9934-425c-9ecd-17baf9aee427 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:42.478241 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.compute.api [None req-70d8703b-9934-425c-9ecd-17baf9aee427 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120654) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:18:42.485048 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-70d8703b-9934-425c-9ecd-17baf9aee427 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:42.485534 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-70d8703b-9934-425c-9ecd-17baf9aee427 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:42.485963 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-70d8703b-9934-425c-9ecd-17baf9aee427 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:42.486668 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-70d8703b-9934-425c-9ecd-17baf9aee427 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:42.487122 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-70d8703b-9934-425c-9ecd-17baf9aee427 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:42.487558 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG oslo_concurrency.lockutils [None req-70d8703b-9934-425c-9ecd-17baf9aee427 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:42.502834 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.wsgi [None req-70d8703b-9934-425c-9ecd-17baf9aee427 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] HTTP exception thrown: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-70d8703b-9934-425c-9ecd-17baf9aee427 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Request method failure captured: Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: request: DELETE /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b HTTP/1.1 Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept: application/json Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Accept-Encoding: identity Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Connection: close Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Length: 0 Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Content-Type: application/json Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Host: 10.222.0.20 Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: Openstack-System-Scope: None Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: User-Agent: python-urllib3/1.26.12 Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Auth-Token: gAAAAABjD0G_5CnX0bgu49qBKEATrPjG5ij1O-g_F-tJeS3zcQuveUNLmpeNedxKK-hb2CtQauSFh7J_yZUA84PLFjvGSp83HfmZq41rhTg89kUz9RglDEWJhTTgATyWoUcj7nI28YGWmyXan6KrHqcZ7FwaN-TfvwTMYRnoebG29g96CCD25E0 Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Id: None Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Domain-Name: None Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Identity-Status: Confirmed Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Is-Admin-Project: True Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Id: default Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Domain-Name: Default Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Id: da5b36cb688f49e1bf1cf75a108858fa Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Project-Name: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Role: reader,member Aug 31 11:18:42.504597 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Roles: reader,member Aug 31 11:18:42.507484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da5b36cb688f49e1bf1cf75a108858fa"}]}] Aug 31 11:18:42.507484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:18:42.507484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Id: da5b36cb688f49e1bf1cf75a108858fa Aug 31 11:18:42.507484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-Tenant-Name: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:18:42.507484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User: tempest-TestVolumeBootPattern-1688397389-project Aug 31 11:18:42.507484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Id: default Aug 31 11:18:42.507484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Domain-Name: Default Aug 31 11:18:42.507484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Id: 16696c34de254f3babf538c879f2ce49 Aug 31 11:18:42.507484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: X-User-Name: tempest-TestVolumeBootPattern-1688397389-project Aug 31 11:18:42.507484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: method: > Aug 31 11:18:42.507484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: exception: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:18:42.507484 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: action_args: {'id': '73a86bd6-faab-4980-ac6b-19ecb1d2bf5b'} Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:18:42.509059 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:18:42.512095 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: ERROR nova.api.openstack.wsgi Aug 31 11:18:42.515277 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-70d8703b-9934-425c-9ecd-17baf9aee427 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Returning 404 to user: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. {{(pid=120654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:18:42.515277 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-70d8703b-9934-425c-9ecd-17baf9aee427 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 404 len: 111 microversion: 2.1 time: 0.032759 Aug 31 11:18:42.515277 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 588/1106] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 11:18:42 2022] DELETE /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:18:42.518590 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cd80948e-d519-4a12-814d-313bde7f1fb9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '>' {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:42.519218 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.compute.api [None req-cd80948e-d519-4a12-814d-313bde7f1fb9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] [instance: 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b] Fetching instance by UUID {{(pid=120655) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:18:42.525693 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cd80948e-d519-4a12-814d-313bde7f1fb9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:42.526211 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cd80948e-d519-4a12-814d-313bde7f1fb9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:42.526652 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cd80948e-d519-4a12-814d-313bde7f1fb9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:42.527369 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cd80948e-d519-4a12-814d-313bde7f1fb9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Acquiring lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:18:42.527854 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cd80948e-d519-4a12-814d-313bde7f1fb9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:18:42.528799 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG oslo_concurrency.lockutils [None req-cd80948e-d519-4a12-814d-313bde7f1fb9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Lock "113279e0-ed70-4e73-b063-0d2b7c31aff4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:18:42.544879 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.wsgi [None req-cd80948e-d519-4a12-814d-313bde7f1fb9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] HTTP exception thrown: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cd80948e-d519-4a12-814d-313bde7f1fb9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Request method failure captured: Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: request: GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b HTTP/1.1 Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept: application/json Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Accept-Encoding: identity Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Connection: close Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Length: 0 Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Content-Type: application/json Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Host: 10.222.0.20 Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: Openstack-System-Scope: None Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: User-Agent: python-urllib3/1.26.12 Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Auth-Token: gAAAAABjD0G_5CnX0bgu49qBKEATrPjG5ij1O-g_F-tJeS3zcQuveUNLmpeNedxKK-hb2CtQauSFh7J_yZUA84PLFjvGSp83HfmZq41rhTg89kUz9RglDEWJhTTgATyWoUcj7nI28YGWmyXan6KrHqcZ7FwaN-TfvwTMYRnoebG29g96CCD25E0 Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Id: None Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Domain-Name: None Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Identity-Status: Confirmed Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Is-Admin-Project: True Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Id: default Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Domain-Name: Default Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Id: da5b36cb688f49e1bf1cf75a108858fa Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Project-Name: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Role: reader,member Aug 31 11:18:42.546449 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Roles: reader,member Aug 31 11:18:42.549101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da5b36cb688f49e1bf1cf75a108858fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da5b36cb688f49e1bf1cf75a108858fa"}]}] Aug 31 11:18:42.549101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:18:42.549101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Id: da5b36cb688f49e1bf1cf75a108858fa Aug 31 11:18:42.549101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-Tenant-Name: tempest-TestVolumeBootPattern-1688397389 Aug 31 11:18:42.549101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User: tempest-TestVolumeBootPattern-1688397389-project Aug 31 11:18:42.549101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Id: default Aug 31 11:18:42.549101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Domain-Name: Default Aug 31 11:18:42.549101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Id: 16696c34de254f3babf538c879f2ce49 Aug 31 11:18:42.549101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: X-User-Name: tempest-TestVolumeBootPattern-1688397389-project Aug 31 11:18:42.549101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: method: > Aug 31 11:18:42.549101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: exception: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:18:42.549101 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: action_args: {'id': '73a86bd6-faab-4980-ac6b-19ecb1d2bf5b'} Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: {{(pid=120655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:18:42.550736 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. Aug 31 11:18:42.553363 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: ERROR nova.api.openstack.wsgi Aug 31 11:18:42.555530 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: DEBUG nova.api.openstack.wsgi [None req-cd80948e-d519-4a12-814d-313bde7f1fb9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Returning 404 to user: Instance 73a86bd6-faab-4980-ac6b-19ecb1d2bf5b could not be found. {{(pid=120655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:18:42.555530 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: INFO nova.api.openstack.requestlog [None req-cd80948e-d519-4a12-814d-313bde7f1fb9 tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b" status: 404 len: 111 microversion: 2.1 time: 0.036250 Aug 31 11:18:42.555530 dv-cinder-855350-1-iscsi devstack@n-api.service[120655]: [pid: 120655|app: 0|req: 519/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 11:18:42 2022] GET /compute/v2.1/servers/73a86bd6-faab-4980-ac6b-19ecb1d2bf5b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:18:43.909775 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: DEBUG nova.api.openstack.wsgi [None req-e2618cfa-55a0-486b-843e-fa8f774050da tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] Calling method '.version_select at 0x7f732d3b0550>' {{(pid=120654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:18:43.958463 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: INFO nova.api.openstack.requestlog [None req-e2618cfa-55a0-486b-843e-fa8f774050da tempest-TestVolumeBootPattern-1688397389 tempest-TestVolumeBootPattern-1688397389-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1158123877" status: 202 len: 0 microversion: 2.1 time: 0.053506 Aug 31 11:18:43.959290 dv-cinder-855350-1-iscsi devstack@n-api.service[120654]: [pid: 120654|app: 0|req: 589/1108] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Aug 31 11:18:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1158123877 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)